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ABSTRACT 



That students change in college is taken for granted. That 
students change as the result of performing in a particular 
curriculum is more ' to show, and describing, who clvip 

and why, in reiatio ch complex abilities, is e. n 

illusive. This longiLu t^al, and cross-sectional study w. 
desi.^ned to investigate three questions: Do students change 
in broad abilities indicative of human potential for cognitive- 
development, learning styles and other generic abilities? 
Can we attribute change to performance in a performance-based 
curricul um , rather than to age, background factors and program 
characteristics? \\[hat are the underlying themes or patterns of 
change that could be used to assist curriculum developers in 
higher education concerned with responding to current frameworks 
in adult learning and development? 

Over 750 students participated in the longitudinal and cross- 
sectional studies by completing a battery of twelve instruments 
with developmental characteristics, and which employed both 
recognition and production tasks. The instruments were drawn 
principally from three sources: cognitive-developmental theory, 
experiential learning theory, and competence assessment designed 
to measure abilities which link those learned in college to 
professional performance afterwards. Students ranged in age from 
17 to 55; 200 formed a core gr mp for the longitudinal study using 
a time series design with ass :^ments at three times during college. 
Change occurred in varying di ees across the Instrument set; 
some of this change could be attributed to performance in the 
learning process when age, background and program characteristics 
were controlled. Cognitive-developmental and learning style 
measures were better indicators of change than were the generic 
ability measures, suggesting that caucators can measure development 
as an aim of higher education. As expected, recognition measures 
showed more change than the production measures. Initial 
performance at entrance to college was related to age for the 
cognitive-developmental measures, and to high school grades for the 
generic ability measures. While more change occurred during the 
first two years (between the entrance assessment and the one two 
years later), the effects of the learning process on student change 
were more evident during the second two years (between the midpoint 
assessment and the one two years later near the end of college). 
Students appear to demonstrate two dimensions of cognitive develop- 
ment, intellectual ability and socio-emotional maturity at entrance 
to college; these abilities are integrated by graduation. 

Implications for practice are that change is measureable, and that 
broad outcomes of college can be specified and assessed. Future 
interpretations of results specific to the several instruments and 
their interrelationships will more directly ccntribute to our 
understanding of the development of abilities learned in college. 
New outcome measures have been tested, and the longitudinal data 
base of college learning is necessary to establish relationships 
between abilities learned in college and professional performance 
in followup studies of alumnae. 
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end College longitudinal participants entering in 
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INTRODUCTION 



This paper addresses the multi-faceted problem of 
identifying, assessing, and validating both classical and 
contemporary aims of liberal education. While societal and 
institutional goals necessarily change in response to trends and 
pressures in the external environment, an enduring goal, central 
to all liberal education enterprises, is that of enabling the 
individual's potential for cognitive or intellectual development. 

The classical problem is to institutionalize the intellectual 
circumstances which help persons become freely functioning 
participants in intellectual activity and autonomous members of 
the intellectual community (Wegener, 1978). This is also a 
contemporary problem, but we now have additional goals focused on 
practical benefits from liberal education. It is doubtful there 
has ever been a time when educators were unconcerned with the 
practical benefits of liberal education, but contemporary aims 
more openly and explicitly stress development toward free 
functioning in social and economic activities along with 
intellectual activities. In any case it is now plainly 
acknowledged that liberal education must show a relationship to 
personal growth , the world of^ work and to economic mobility. 
Whether the stress on these additional goals is implicit or 
explicit, classical and contemporary aims are not different in 
the intent of actualizing human potentials, enabling the student 
to become all that she or he can become. 

We view our work in part as advancing the argument that 
encouraging intentional developmental change in students 
throughout the life cycle should be the overarching purpose of a 
college or university education (Chickering, 1981). We hope this 
research helps to reduce the "size o"^ the existing gap between 
developmental theory and educational practice" (Astin, 1983). 

The task is to identify kinds of development and ways of 
understanding developmental processes in relation to teaching 
and learning ac tivities. To institutionc^.lize intellectual 
circumstances, we must first identify componer.ts of intellectual 
activity and design methods of validating the circumstances which 
enable intellectual activity. 
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What forms of intellectual or cognitive development 
facilitate improved functioning in personal, social, and work 
domains? What generic abilities, cognitive or learning styles, 
dispositions, etc,, work in what relationships to cognitive 
development to enhance growth in college and effective 
performance after college? 

For most of the history of liberal education, these student 
development^^ goals have been considered to be the more 
"intangible" outcomes of college. In the past half century, ideas 
and methods have begun to evolve which create the possibility of 
approaching these aims in more tangible ways. While the more 
visible preoccupations of the past two decades have been student 
political activism and then fiscal problems and declining 
enrollments, there has been steady development in, and a growing 
concern with, operational understanding of student development 
outcomes since publication of The American College (Sanford, 
1962), ~~ 

The social and behavioral sciences have not only begun to 
open the worlds of intellectual and social development of the 
young; they show that development can and does occur over the 
full life span (Knox, 1977; Mentkowski, 1980). These "new" 
domains of knowledge and methods of inquiry have stimulated 
educators in all fields to think about what they do to promote 
life-long development and how they do it. They are asking these 
questions in relation to the classical aims of intellectual or 
cognitive development, and in relation to other abilities 
developed in college towards future personal and professional 
performance (Mentkowski & Doherty, 1977, 1983). 

While some educators may have an intrinsic interest in 
studying developmental and career-related change in college, 
there are other reasons to identify, assess, and validate student 
outcomes. As new populations of students come to college, it 
becomes obvious that a good deal of the recognized character, 
processes, and value of liberal education were intimately 
connected to the personal and socio-economic characteristics of 
the traditional liberal arts student. More and more students, of 
all ages, come to college already pursuing a career or with a 
particular career already chosen (Astin, 1982). They come to 
college to p.-epare for a career or to advance themselves in a 
career they have already begun. They want a liberal education as 
always (Levine, 1978), but they want it to fulfill definite and 
present purposes. "Business as usual" in liberal education is 
inadequate not just for the new populations of older, minority, 
or women students; it is inadequate for the now more 
career-minded traditional student as well. The new knowledge 
afforded by study of intellectual and career- related outcomes is 
needed to adapt curricula and teaching methods that respond to 
developmental patterns, learning styles, and generic abilities of 
adults of all ages and circumstances. 

The current state of knowledge and practice concerning 
developmental goals of higher education has recently be surveyed 
by Chickering and others in Th(B Modern American College 
(Chickering, 1981). Numerous conceptual frameworks and bodies of 
empirical research are presented. The Alverno faculty 
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anticipated many of these learning and development goals in their 
curricular reorganization in the early seventies. Thus, several 
frameworks presented in The Modern American College were integral 
to our longitudinal study of student change. In., particular, we 
identified the concepts of ego, moral, and cognitive development, 
experiential learning theory and individual lea'rning styles as 
critical components of intellectual activity. 

Human Potential: Cognitive Development 

To assess students' college learning in the context of 
life-long learning and development, we used 

cognitive-developmental theorists' descriptions of human growth 
and development as sources for college outcomes measures 
(Mentkowski & Doherty, 1977). Developmental psychologists have 
described broad developmental domains that can be measured, such 
Hs moral development (Kohlberg, 1976, 1981); ego development 
(Loevinger, 1970, 1976); cognitive development (Piaget, 1958, 
1972); and intellectual and ethical development (Perry, 1970, 
1981 ). These theorists provide us with descriptions of ways in 
which individuals cognitively structure meaning and make sense 
out of their experiences. Descriptions of development, whether 
via a series of stages (Piaget, Kohlberg), ego levels 
(Loevinger), or positions (Perry), provide us with a partial 
picture of students* potential for growth. They describe some of 
the more universal outcomes human functioning against which 
educators can validate heretofore intangible curriculum outcomes. 

While we do not expect that educators will use a student's 
current developmental level, position or stage as a measure of 
performance to credential or pass a student, such information can 
be used to describe where the student is in his or her 
development. Assessing student performance on these measures 
over time gives us important information on individual patterns 
of development during college, and helps us evaluate the extent 
to which college and/or specific curriculum interventions are 
contributing to the general cognitive growth of learners. 

This approach to validating student outcomes suggests 
assessing students on various levels of cognitive development as 
part of program validation design3. The results can be used to 
inform instruction^ and to assist in creating appropriate 
curricula. 

At Alverno College, the student's continual development is at 
the center of institutional goals. An overriding concern of 
educators is to foster the development of the whole person. It 
is precisely because the student's development is at the heart of 
Alverno * s educational Jiilosophy that we have used 
cognitive-developmental descriptions of human growth as college 
outcomes measures. The faculty works to develop processes 
accountable to the best available understandings of overall human 
potential. We do not propose that any educational institution 
select cognitive-developmental descriptions as one basis for 
measuring college outcomes unless similar relationships can be 
drawn between the goals and objectives of the institution and 
such developmental descriptions of growth. 
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Human Potential: Generic Abilities 



Several efforts in assessing college outcomes are 
specifically focu'^e'^ on performance measures of general abilities 
and characteristics predictive of effectiveness in later life 
(e.g., act's College Outcome Measures Project, McBer and 
Company's Cognitive Competence Assessment Battery). These more 
focused measures might appear more redundant with the usual grade 
repo rts and standardized achievement or aptitude tests in 
predicting future performance. Yet these conventional measures 
and indices have not shown much relationship to later behavior 
(McClelland, 1973). The effectiveness of the new performance 
measures has not been determined by any means, but initial tests 
have been encouraging (Winter, McClelland & Stewart, 1981). 

In the recent past, some educators, colleges and professional 
schools have identified performance outcomes and developed ways 
to assess them. (These have included, besides Alverno, College 
III, Florida State, Harvard University, Kirkhof College, Mars 
Hill College, Metropolitan State, New Rochelle College, Our Lady 
of the Lake, Sterling College, Antioch School of Law, College for 
Human Services, Mt. Hood School of Nursing, Southern Illinois 
University School of Medicine, and others.) Many of these 
institutions are now addressing program validation issues. They 
are asking hard questions about the extent to which students are 
able to demonstrate outcomes educators have identified as 
important for college students to master. 

In 1975, the Fund for the Improvement of Postsecondary 
Education supported a consortium of colleges in trying out some 
newer measures to assess outcomes. As a member of this group of 
colleges, Alverno participated in the FIPlSE project, awarded to 
McBer and Company, by administering some of these new measures. 
These instruments, collected or developed by McBer, later became 
known as the Cognitive Competence Assessment Battery (Winter, 
McClelland & Stewart, 1981). 

When Alverno sought to identify external criterion measures 
for inclusion in a validation study of student outcomes, we 
selected these measures because they most nearly represented some 
of the abilities identified by Alverno faculty. The Cognitive 
Competence Assessment Battery (Winter, McClelland & Stewart, 
1981) provided a particular focus on generic abilities of 
analysis, and included assessment of motive dispositions and 
other charac teristics important to the relationship between 
learning and later behavior. 

For this combination of practical and theoretical reasons, as 
we moved from broad purposes to research questions and 
instrumentation, we assembled a set of twelve instruments to 
assess cognitive-developmental and career-related outcomes. 
Seven of the twelve were based on the cognitive-developmental 
theories of Piaget, Kohlberg, Loevinger, and Perry, and the 
experiential learning theory of David Kolb (in press). These 
included : 
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• Measure of Vocational, Educational and Personal 
Issues (Knefelkamp, 1974; Widick, 1975; now titled: 
Measure of Intellectual Developnent; after Perry) 

• Sentence Completion Test (Loevinger, et al., 1970) 

• Moral Judgment Instrument (Kohlberg, et al., 1978) 
et al, , 1978) 

• Defining Issues Test (ReSv , 1979b) 

• Test of Cognitive Development (Rennar et al,, 1976; 
after Piaget) 

• Learning Style Inventory (Kolb, 1976) 

• Adaptive Style Inventory (Kolb, 1978) 



For more focused abilities and characteristics, we used 
McBer and Company's Cognitive Competence Assessment Battery, including: 

• Picture Story Exercise (scored for Stages of 
Adaptation (Stewart, 1977b); Self-Definition 
(Stewart & Winter, 1974); and Achievement 
(McClelland et al., 1953), Affiliation 
(Atkinson, 1958), and Power (Winter, 1973) 
motives) 

• Test of Thematic Analysis (Winter, 1976) 

• Analysis of Argument (Stewart, 1977a) 



W^ added, as another measure of critical thinking abilities: 

• Watson-Glaser Critical Thinking Appraisal 
(Watson & Gl aser, 1964) 



Finally, a new measure of interpersonal abilities being developed by 
McBer and Company was included: 

• Life History Exercise (Klemp & Connelly, 1977) 



Clearly, selection of frameworks, and corresponding 
instruments as external criteria against which a college examines 
its ability to facilitate student growth is appropriate if there 
is 1 ) a match between the goals and objectives of the college and 
the framework used and 2) a match between the college's theory of 
assessment and the theory of assessment used to develop 
instrumentation based on the framework: 
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Instruments which have been used for theory- 
testing — even though they have demonstrated reliability 
and validity — need to be filtered first through the 
practitioner' s goals , obj ec tives , learning strategies 
and assessment processes. Once they emerge from this 
c rucial dialectic, they may be effective program 
evaluation instruments as rfell (Mentkowski , 1980, p. 
28). 

Therefore, our work using any of the measures as an 
assessment of college outcomes needs to be understood in the 
context of its use at Alverno College. This context includes an 
outcome- centered curriculum and principles of assessment which 
have been in the process of development by Alverno faculty for 
over ten years. A fuller treatment of the rationale for selection 
of these measures is included in Mentkowski and Doherty (1983). 

Alverno Learnin g Process 

Alverno Competences 

Outcomes identified by Alverno facu]ty as descripti' e of the 
liberally educated person (Alverno^ College tf'aculty, 1976) consist 
of a theoretical and. pedagogical framework of eight competences: 

• Communications 

• Analysis 

• Problem Solving 

• Valuing 

• Social Interaction 

• Taking Responsibility 
for the Environment 

• Involvement in the 
Contemporary World 

• Aesthetic Response 

The competences and an accompanying theory of learning and 
ai^ressment are the product of curriculum development 
collaborati ely undertaken by the corporate faculty in 1971* The 
faculty implemented an outcome-centered curriculum in 1973, which 
is continuously revised and developed out of the faculty's 
experience teaching and assessing students. 

Each of the competences is defined as generic, developmental 
and holistic. The term generic means that the competences are 
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attributes or characteristics of the student herself. Vhile they 
are learned and demonstrated in specific settings, these generic 
abilities can be modified and transferred to a variety of 
situations. The term developmental means that each competence is 
analyzed into a set of six competence levels that are sequenced 
in a progressive learning pattern (these pedagogical levels are 
not thought of as cognitive-developmental stages or positions) . 
Students are required to attain competence levels in sequence and 
to demonstrate cumulative mastery. Finally, the competences are 
holistic. While the faculty break them into levels and 
components to teach and assess them, they see the competences as 
inseparable parts of the whole person they are seeking to develop 
as educators (Alverno College Faculty, 1979). 

Alverno faculty conceptualize education in part as developing 
each student* s personal and professional potential by 
increasingly involving the student in her own learning. Alverno 
educators ask the student to actively engage herself in the many 
learning contexts available to her. Faculty expect her to 
ultimately become self-directed in her own learning, to become 
the initiator, setting the direction of her development (Earley, 
Mentkowski & Schafer, 1980). Faculty have designed learning 
methods and assessments to teach toward and measure the 
competences and other more intangible outcomes of college, with a 
heavy emphasis on creating opportunities for "experiential 
learning" (Ooherty, Mentkowski & Conrad, 1978). 



Alverno Principles of Assessment 

The Alverno faculty developed an assessment process for 
evaluating students' increasingly sophisticated performance on 
the eight broad competences described as outcomes of college. 
The characteristics and principles of the assessment process are 
described in Assessment a^ Alverno Coi^ ^ lege (Alverno College 
Faculty, 197977" 

and represent one of the more recent directions 
in reconceptualizing assessment (Willingham, 1980). 

One characteristic of this approach to assessment is a focus 
on measuring performance, rather than knowledge alone. Because 
of the complexity of the performances being assessed, faculty 
design instruments complete with stimulus, performance mode and 
criteria designed to elicit to the fullest extent, the student's 
developing ability. Thus, Alverno faculty have conunitted 
themselves to designing assessment techniques that employ 
production tasks rather than recognition tasks. That is, the 
student is required to generate a response to an instrument's 
scimulus, rather than simply to indicate recognition of 
information. Consequently , faculty are likely to employ 
performance mod es such as essay, group discussion, oral 
presentation, interview, and in-basket, rather than modes such as 
mul tipl e choice, short answer, true- false , etc. Performance 
modes are designed requiring her to demonstrate behavior similar 
to the ability as usually expressed rather than an artificial 
mode (e.g., to demonstrate Social Interaction skills, she would 
perform in an actual group discussion; a nursing major would 



demonstrate higher levels of this ability with clients in a 
health care setting), 

A predominant mode of assessment represented by the external 
criterion measures in contrast to most studies of college 
outcomes (Astin, 1977; Pace, 1980) is the production type task. 
Production tasks necessitate development of a judging process and 
trained assessors. Of the twelve measures, in this study of 
student change, six require assessor training and reliability 
studies to insure the validity of expert judgment and the scores 
assigned to performance. 



Alverno's Office of Research and Evaluation has also 
developed strategies for validating instruments and competences. 
These strategies involve criteria evaluation, establishing 
inter-rater reliability of assessor judgments, and comparing 
instructed and uninstructed student performance. The office, in 
collaboration with faculty, conducts studies that examine the 
extent to which instruments measure the effects of instruction, 
analyzes student performance across competence levels, compares 
cross-college performance across competences, etc. (Friedman, 
Mentkowski, Earley, Loacker & Diez, 1980; Friedman, Mentkowski, 
Deutsch, Shovar & Allen, 1982; Mentkowski, Moeser & Strait, 
1983). All of these st rategies contribute to faculty 
understanding of the nature of the competences being assessed and 
the specification of the criteria for student performance 
aasessment. 

The relationships between faculty questions and components 
of the learning process are presented in Graphic 1. This report 
focuses on one part of the process, student changes in outcomes. 
It focuses on outcomes expected from a liberal education, bu^^ not 
those outcomes specifically credentialed. This distinction x3 an 
important one: the eight competences identified by Alverno 
faculty are outcomes credentialed through Alverno's assessment 
process; the outcomes studied in this research, as instrumented 
with the cognitive-developmental and generic ability measures, 
represent expected but not credentialed outcomes. 

The strategies for validating these outcomes, and the 
learning process as a whole, were developed as part of Alverno's 
overall validation efforts. In 1976, Alverno began 
conceptualizing and carrying out a model designed to validate its 
outcome-centered curriculum (Mentkowski & Doherty, 1 977; 
Mentkowski, 1980). The model incorporates various research and 
evaluation methods , with the ultimate goals of establishing 
program val id ity , contributing to program development , and 
developing a picture of adult learning and development that can 
be used in the servic e of goal setting, assessment and 
instruction. Most strategies are designed to illuminate how 
students learn in college, to follow students in their various 
personal and professional roles after college, and to chart the 
longitudinal patterns of learning demonstrated by students as 
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LEARNING PROCESS 



What are the deveiopmental, 
holistic and generic abilities each 
student must demonstrate in order 
that we consider her a lifelong 
learner? 

How can we develop these abilities 
In each studein so they become 
internalized, integrated and 
generalizable? 
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EXPERIENTIAL 
LEARNING 







How will we know if each student 
has achieved these abilities according 
to our prescribed standards? 



ASSESSMENT 

PROCESS, 
TECHNIQUES 



Is the learning process we use to 
develop and assess for abilities 
actually working the way we have 
designed it? 

Are changes in performance of 
student outcomes related to college 
instruction? What is the relationship 
between current outcomes and 
future outcomes? 

How do current and future student 
outcomes compare against internal 
and external standards? 



What are the outcomes of the 
learning process, those credentialed 
and those expected but not 
credentialed? 



What are the students' realizations 
in perception and professional 
performance as a lifelong learner? 



EVALUATION/VALIDATION PROCESS 



STUDENT 
CHANGES IN OUTCOMES 



ALUMNAE 
FUTURE OUTCOMES 



Graphic 1, Faculty Questions and Aiverno Learning Process Components 
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they move through the curriculum. In addition, we are working to 
validate the curriculum through studies of the competences 
demonstrated by practicing professionals in professional areas 
characteristic of those chosen by our students (Mentkowski & 
Doherty, 1983). 

Graphic 2 details the several componen'^s of the validation 
model. Graphic 2 elaborates Graphic 1, showing with arrows the 
feedback loops in the model in addition to the multiple 
validation components. 

The study of "potential'* and "performance" and their 
interrelationships are included in this report. Students who 
contributed data for this study were a subset of those for whom 
"performance characteristics" data were collected, and a superset 
of those who contributed to the "perceptions" component. Some 
were followed up after college for the study of alumnae future 
outcomes. Other papers present results linking components of 
this report to performance in the Integrated Competence Seminar, 
and the Six Performance Characteristics Rating (Alverno 
Assessment Committee/Office of Research and Evaluation, 1982 , 
19 S3). This report relates' the measures of "potential," the 
cognitive-developmental and generic ability measures, to the 
following performance indices: 



In addition, we collected information from students that 
would allow us to measure and examine the degree to which change 
is due to differences in age, background or college program. 



A major purpose in undertaking this study was to bridge the 
gap between researchers* current work with these frameworks and 
instrumentation, and educators* development o f learning and 
assessment techniques that assist students to develop the more 
sophisticated constructs and patterns the theories describe. 

We recognize that our work with the constructs measured and 
our own experiences carrying out this study have benefits to the 
larger research community working to continually extend and 
further validate the instruments and the theories they represent. 
This study will aid in the development of college outcome 
instruments that are better measures of the constructs under 
study. We expect that our use of these instruments as college 
outcomes measures within a context such as Alverno will enable 
faculty in higher education to create learning strategies and 
assessments that rest on an understp.nding of patterns of adult 
development and learning. This study, in response to these 
issues, researches the following questions: 



• Number of semesters enrolled 



• Semester credit hours completed 



• Competence level units accumulated 



Research Objectives 
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Graphic 2. Components of a Validation Model for the Alverno 

Learning Proc<^ss with External Validation Initruments 
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• How do student outcomes compare with their 
potential for realizing cognitive developnent 
and generic abilities? 

• How do students change over time on measures 
of human potential? 

• To what extent is change due to college 
performance rather than differences in age, 
background, or college program? 

• What patterns of change emerge in the 
interrelationships of the human potential 
measures of cognitive development and generic 
abilities, and generic measures of college 
performance and performance characteristics? 



This section describes some of the boundaries and special 
emphases of the present study. From the beginning we want to 
emphasize that this report opens but does not close our study of 
student change in cognitive development and generic abilities. 
Besides continuing to follow Alverno's students into the world of 
work as part of our broader program validation model, we are 
committed to using our data to promote curriculum development and 
advance theory and research practice in higher education and 
adult learning and development. 

We set out the major questions with which we began, making 
only a first pass through the collected data to answer those 
questions at the most general level. Along the way we focus on 
some special concerns that figured in the initial organization of 
the study, and that form the external framework of the data in 
this initial report. A complex approach to program validation 
must be reported as a series of studies. Therefore, this report 
appears to leave a great deal unsaid or unexamined. We do plan 
additional work with the data bank we have created. 



Focus on Change 

Our pivotal concern is the study of change. The first 
implication is that we do not focus on what level of development 
or what degree of an ability seems to be manifest at the 
beginning or end of college. We are focused on change over time 
and the relationship of those changes or lack of changes to 
student, program, and performance differences. We do not begin 
by doubting that change occurs. We know, as do all experienced 
educators, that students undoubtedly change during college. And 
we do not doubt that the older or returning students, who make up 
half of our student body, change as well as traditional age 
students. If we are not questioning the fact of change, what are 
we doing? We wish to learn whether certain fundamental and 
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enduring changes, which we and others believe can and should 
occur with liberal education, can be measured in ways that will 
help us to better understand and facilitate such change. The 
objective is simple, the task is complex. Our successes and 
failures in measuring change will not prove or disprove the fact 
of change; we hope that both our successes and failures will 
teach us more about the ways we can study and effect desired 
change. 

We examine cross-sectional as well as longitudinal 
differences. While our emphasis is on the longitudinal study in 
subsequent questions, cross-sectional data provide an important 
kind of interplay with longitudinal data in studying change. In 
particular, cross-sectional results are not: subject to effects of 
retesting or uncontrolled events between assessments, since they 
involve a single a:^sessraent of comparison groups at the same 
time. The interplay between longitudinal and cross-sectional 
results gives us information that can not be obtained from either 
design alone. In the simplest case, significant differences 
between entering and graduating students in the cross-sectional 
study, followed by significant change over time in the 
longitudinal study, builds a stronger case for change. 

Relating Change to College 
Performance 

Our second question is, to what can we attribute measured 
change? We are of course aiming for a link between measured 
change in development and generic abilities and the learning 
process implemented by the college. We want to find not just 
that college makes a difference, but the kinds of difference it 
makes. In this first phase of data analysis concerning this 
question, we have taken the position that if anything logically 
or chronologically prior to a student's performance in college 
can explain measured change, we can not stake our claim to have 
influenced that change with the learning process. But if we can 
account for many prior relationships between change and student 
or program differences, and still associate change with student 
performance, then we have reason to invest more time, money, and 
energy in exploring the details and dynamics of that connection. 

This is not to say that we have no further interest in 
evidence of change that can be accounted for by other variables 
than student performance in the learning process. While we 
cannot control student background characteristics , information 
about different change patterns related to individual differences 
can provide leverage in the design of programs and in offering 
guidance to new students. Differences attributable to program, 
such as resident status or major, are more within the control or 
influence of the college and these variables can be modified to 
enhance the prospects for desired change to some degree. 
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Underlying Themes of Change 



The third main question of this study is to identify any 
underlying themes of change that may only be evident in the 
multiple relationships of the several kinds of outcomes we are 
attempting to measure. At the bottom of our many layers of 
assumptions and goals affecting the nature of this work is the 
clear knowledge that the person, analyzed into hundreds of 
aspects, dimensions and events, is a living organic unity. 

While we assume as part of our framework for understanding 
persons that there are degrees of integration and fragmentation 
in any person's character and abilities, there are most certainly 
not as many discrete and independent events as we have measures. 
Among our measures are tests of intellectual, moral, and ego 
development, learning style, and several abilities and 
characteristics important to learning. Can we see, by 
considering many such measures of many students over multiple 
occasions, what underlying change is taking place in the organic 
whole? This question is rife with difficulties of concept and 
method, but we have made a start in responding to it nonetheless. 



Organization of the Ana]3'-sis 
and Results 

Educators and researchers in different settings could take 
these three major questions and the identical battery of 
instruments, and produce several different reports covering 
little of the same territory. This is not a statement about the 
generalizability of the findings, but about the variety of 
perspectives and special concerns which can and do shape results 
at the point of planning the data analyses. Along the way we 
have been pulled or pushed by many special concerns; some of 
local importance, and many of general importance to other 
educators and researchers. 



Age and Age Cohort 



Prominent in our report is our concern with age and age 
cohort differences. Because our student population ranges in age 
from 17 to 55 years, and because we expect to continue to attract 
Older students in the future, we have a special opportunity to 
examine change across a larger range of adult life in relation to 
college learning. It is not age per se that we are interested 
in, but the broad life experience differences for which the 
variable of age can partially proxy in our study. We have used 
age, broken down into traditional and older student cohorts, to 
compare the general influence of life experience to formal 
education experience in change over time on all measures. We 
have used age, standing in part for life experience in general, as 
the logical first cause of differences in development and other 
abilities when beginning the causal analysis of change. While 
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age used in this manner helps us to construct the most 
conservative estimates of possible effects of the learning 
process, and thus to make general decisions about future areas in 
which to invest ourselves, it plays a different and less positive 
role in relation to detailed analysis and theory building. In 
ensuing phases of our analysis, the role of age will be 
diminished as we look for those particular aspects of life 
experience which aid or compete with college as contributors to 
student development and learning. 



Class Cohort 

Another special concern which plays a large role in the 
structure and organization of the study is that of class cohort. 
For the purposes of general program validation, we undertook the 
extra effort of studying two successive years of class cohorts to 
minimize the possibility of unseen cohort effects in our general 
conclusions about change (Nesselroade & Baltes, 1979). Similar 
issues spring up in relation to change as with age. The cohort 
variable is not intereoting in itself, but it proxies for 
whatever events on a social level were influential in student 
selection of a year to enter college. With the age range of our 
population, and the volatile envj.ronment of the seventies and 
eighties in the changing roles of women, this issue is not 
trivial. It is particularly not trivial at Alverno as a college 
for women, many of whom are first generation college students. 
Again, more in-depth probes of the data reported here will 
require ways to get beyond this large variable to particular 
social influences. 



Methodol q^c a 1 s s u_e s 

Time Series Analysis 

Several methodological issues contributed a certain special 
character to the framework of our study over and above the 
special concerns just addressed. In overall design, special note 
must be made of the use of constant time intervals in scheduling 
the three assessments in the longitudinal study. The problem we 
are anticipating is the ambiguity caused by the approximation of 
times of assessment to regular classification levels of students 
or to structural components of the curriculum. Many studies of 
college effects, whether cross-sectional or longitudinal, have 
assessed students when they are freshmen and when they are 
seniors, for example. In contrast, we have assessed an entire 
entering class as they began their studies. Most will be new 
freshmen, but many will have prior college credits and, in class 
terms, will be sophomores or juniors at entrance assessment. We 
have then re-assessed the members of an entering class who are 
attending Alverno two years later. A typical student who 
entered as a new freshman and attended regularly for two years 
might in fact be a first semester junior at second assessment, 
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but another student might have entered Alverno as a sophomore by- 
standing, taken only two courses in the entering semester, not 
I egistered again until second assessment, and still be a 
sophomore • 

When appropriate, we take advantage of the fact that our 
design apprc^ximates the beginning, middle, and end of a typical 
student's college career, or that the assessment intervals 
approximate 1;he periods of general educat ' on and pre-professional 
education f c r the typical student, Ocill, it is important to 
remember thei this does not accurately describe the case for all 
students in ine study. It is precisely this variability in 
attendance ar'-l performance over a specified period of time that 
we use to investigate claims of change effects for the learning 
process as a glooal entity. 



Rate of l\'irtLcLpat Lun 

Readers experienced in longitudinal data collection will be 
interested in the extensive and detailed description we provide 
of our data collection procedures. We employed a range of 
effective strategy , s to get and keep the cooperation and 
participation of all students entering during the two-year 
entrance phase of the project. The continuous effort to motivate 
students to participate, and the feedback mechanisms in 
particular will raise questions about our. results that we cannot 
answer. By some traditional research standards, our efforts may 
be seen as contaminating the data and reducing its 
generalizability to populations not so motivated. We have taken 
the position that a worse kind of contamination of results is 
incomplete data. We have accepted the risk of motivating students 
to participate in order to achieve the highest possible rates of 
participation, and because we are ultimately interested in 
stimulating the highest level of their performance. 



Matching Comparison Groups 
for Persistence 

A well known problem with compering groups of entering and 
graduating students in cross-sectional studies is that entering 
classes include many students who will not persist through 
college, while a graduating group consists of persisters by 
definition. Many studies try to control for this difference by 
matching students on some variable believed to predict 
persistence, most often an academic achievement variable. We 
explain in pur research design section how we were able to 
control directly for persistence in the cross-sectional study by 
using one of the entrance cohorts of the longitudinal study as 
our entering student comparison group. 
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Mt^asii res 



We focus on overall trends and aggregate data to answe- 'he 
initial questions posed in this report. Detailed outcomes ^re 
presented in terms of multiple unit outcomes and in a particular 
format designed to reveal what we anticipate will be figural 
questions of the next phases in the analysis. 

Two forms of organization were explicitly built into some of 
the table formats to prepare for our second phase: the 
production vs. recognition characteristic and the developmental 
continuum characteristic. 

The task characteristic of production versus recognition has 
been given a thorough treatment by McClelland (I98O) though he 
refers to them as "operant" versus "respondent" measures. The 
basic issue is that, across many kinds of research questions, 
assessment tasks that in some way ask the participant to respond 
in the terms of the test developer rather than create or produce 
a response, have been poor predictors of future behavior of the 
person. Recognition measures test the investigators* reality, 
but not necessarily the reality of the participant, and it is 
usually the participant we want to know something about. While 
this perspective puts a higher value on operation or production 
measures, a more neutral view would still hold that the two types 
of measures assess different things, so there is more to learn by 
using both types of measures. We have intentionally 'ised. 
produc tion and recogni tion measures , and plan to p ^suc 
question in later reports. For now the reader can, m : ong ... ch 
us, see patterns of difference at a glmce illuminated simply by 
the ordering of the measures in the tables. 

Deve lopmental Character is tics 

The same preparation for future research was made with 
respect to the question of the developmental character of each 
measure. Some of our measures were designed by developmental 
psychologists to explore developmental phenomena, but others were 
designed for other purposes. Our beginning assumption is that 
performance on every measure has a developmental component, but 
that there are aspects of the task which are affected by 
non-developmental experiences and abilities. We have organized 
the displays of outcomes according to our initial understanding ot 
the instrument's developmental character as well as its type. 



Methods ^f_ Analysis 

The analyses reported correspond to the three major questions 
presented above. Change was examined first in cross-sectional 
and then in longitudinal data. The longitudinal data were 
analyzed for change in two ways: first, assessments over all 
three occasions were analyzed as a function of time; second, 
change during each interval was investigated. Differences 
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between entering students and graduating students in the 
cross-sectional study were compared with change across time and 
between intervals in the longitudinal study. 

To relate change to performance in college, a series of 
analyses were conducted to explain as much change as possible in 
terms of other factors than performance before testing for 
performance effects. First, age and other background variables 
(religion, parent's education and occupation, high school grades, 
prior college experience, and marital status) were tested for 
correlation with entrance assessments. Those variables that 
accounted for differences in entrance assessments were then 
further examined for relationship to change between assessments. 
If any background variable accounted for change between 
assessments , then that difference was controlled in testing 
effects of performance. Similarly , eff ec ts of prograr.i 
differences incidental to the learning process (entrance cohort, 
residence, part-time or full-tinie status, and major) were tested 
after background variables but before testing for performance 
effects. Program variables accounting for change over that 
accounted for by background variables were al.^o controlled before 
testing the relationship of change to performance. Thus, any 
relationship between performance and change was only considered 
an effect of performance once the other pootj^ble sources of 
variance we measured were controlled. 

There are many relationships among outcome measures that 
might reveal patterns of student learning and development. Our 
first step in this direction was to reduce the data through a 
series of factor-analytic studies in search of underlying themes 
of change. Factors derived from entrance assessments were 
studied most carefully on the assumption that later assessments 
could be affected in unknown ways by test familiarity. Factor 
analyses were then conducted on sets of measures from second and 
third assessments which would replicate the analysis of entrance 
assessments. With interpretation of the factors based on 
entrance assessment data, we examined changes in the primary 
factors and secondary factors across assessments. 



Summary 

This paper addresses many issues related to the 
identification, assessment and validation of classical and 
contemporary aims of liberal education. Building on 
accomplishments of the social and behavioral sciences over the 
last few decades, we employ several theories and measures of 
cognitive development and other generic abilities as external 
criterion measures in a multi-dimensional evaluation /validation 
process aimed at understanding the ways students learn and grow 
in an outcome-centered liberal arts curriculum. We particularly 
hope to demonstrate through this report some ways in which the 
existing gap between developmental theory and educational 
practice may be reduced or bridged. 
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METHOD 



The Measures 



Cognitive-Developmental Measures 

Five instruments were selected on the basis of their 
definition as measures of broad domains of human development, 
particularly cognitive and psychosocial development. These are 
aspects of human potential which might reasonably be affected by 
college learning, and represent student development objectives of 
Alverno faculty. 



Measure of Vocational, Educational, 

and Personal Issues (Measure of Intellectual Development) 

The^ MVEPI, formerly called the KNEWI (an acronym of the 
authors' names), was developed by Knefelkamp (1974) and Widick 
(1975) and revised by Knefelkamp and Slepitza (1976), The 
instrument, now called the Measure of Intellectual Development 
(Mines, 1932; Moore, 1982), was developed to assess intellectual 
and ethical developnent as originally described by Perry (1968, 
1970) and his colleagues at Harvard's Bureau of Study Counsel. 
This developmental scheme, abstracted from in-depth analysis of 
longitudinal interview data collected from Harvard undergraduates 
in the mid-fifties and earl/ sixties, details a progression of 
positions which 

characterize the structures which students 
explicitly or implicitly impute to the world, 
especially those structures in which they construe 
the nature and origins of knowledge, of value, and 
of responsibility (Perry, 1970, p.l). 

The progression of positions is briefly described in Table 1. 
The scheme has recently been presented again along with a review 
of several research and intervention programs it has spawned 
(Chickering et al. , 1981). 

To complete the MVEPI, st ..dents were asked to write three 
short essays describings a) "the best class you've taken . . . 
b) "a decision about something that had major importance . . . 
and 0) "things you consider when approaching . . . the question 
of career choice . . . While these questions were retained in 

the same form throughout the study, the rating procedures and 
criteria initially formalized by Knefelkamp (1978) were 
extensively modified at Alverno before final rating (Mentkowski, 
Moeser & Strait, 1983). 

The three essays obtained frQm each student were 
independently rated and the three ratings were retained as 
separate indices in the analyses of outcomes. The scoring system 
used permits the designation of a 'stable'' position rating, or a 



33 



Table 1. 

Main Line of Development of Perry Sclieme 



POSITION 1: 

POSITION 2: 
POSITION 3: 
POSITION 4: 



POSITION 5-: 

POSITION b: 

POSITION 7: 
POSITION 8: 

POSITION 9: 



The student; sees the world in polar terms of we- 
right-good vs. other-wrong-bad. Right Answer.s for 
everything exist in the Absolute, known to Authority 
whose role is to necliaLe (teach) then. Rnov/ledge 
and goodness are pertte i ved as quarititat ive accre- 
tions 01 discrete r ig*n tnesse;" to be collected by 
hard work and obedience (paradigm: a spelling test). 

The student perceives diversity of opinion , and 
uncertainty, and accounts for them as unwarranted 
confusion in poorly qualified Authorities or a.s mere 
exercises set by Authority "so we can learn to find 
The Answer for ourselves." 

The student accepts diversity and uncertainty as 
legitimate but still temporary in areas where 
Authority "hasn't found The Answer yet." He supposes 
Authority grades him in these areas on "good expres- 
sion" but remains puzzled as to standards . 

(a_) The student perceives legitimate uncertainty 
(and therefore diversity of opinion) to be extensive 
and raises it to the status of an unstructured 
epistemological realm of its own in which "anyone 
has a right to his own opinion ," a realm which he 
sets over against Authority's realm where right- 
wrong still prevails, or (b) the student discovers 
qualitative contextual relatives t ic reasoning as a 
special case of "what They want" within Authority's 
realm. 

The student perceives all knowledge and values 
(including .".uthority's) as contextual and relati- 
vist ic and subordinates dualist ic r j ght-wrong 
functions to the status of a special case, in 
context . 

The student apprehends the necessity of orienting 
imself in a relativistic world through some form 
of personal Commitment (as distinct from unquestioned 
or unconsidered conuni tment to simple belief In 
certainty) . 

The student makes an initial Conunitment in some 
area . 

The student experiences the implications of Commit- 
ment , and explores the subjective and sty] l.«itic 
issues o f responsibili ty . 

The student experiences the affirmation of Identity 
among multiple responsibilities and realizes Commit- 
ment as an ongoing, unfolding activity through which 
he expresses his life style. 



lam G. Perry, Jr. Forms of Intellectual and Ethical 
lopment in the College Years; A Scheme . New York: 
, Rlnehart and Winston, Inc., 1970. 
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dominant/subordinate' rating indicating transition between 
defined positions of the scheme. The rating scale is symbolized 
wit)i a three digit code. A stable rating shows the same digit in 
all three places (e.g., a stable Position 3 is symbolized by the 
code, 333). Transitional ratings are shown with the subordinate 
position indicated by the leftmost or rightmost digit (e.g., 223 
indicates a dominant Position 2 rating yd.th significant elements 
of Position 3 emerging and 233 indicates a dominant Position 3 
rating with significant traces of Position 2 remaining). 



Senten ce Completion Test 
of Ego Development 

This instrument was designed to assess levels of ego 
development as described in the work of Loevinger and her 
colleagues at Washington University in St. Louis (Loevinger, 
1976; Loevinger ^ Wessler, L970) . In contrast to the fluid state 
of instrument development surrounding Perry's scheme, the 
Sentence Completion Test may be considered an established though 
not immutable instrument for measuring ego development 
(Loevinger, 1979). Table 2 presents a set of milestones used to 
describe the developmental process. Loevinger and Knoll (1983) 
provide a current overview of ego development theory and its 
relationships to other cognitive-developmental stage theories. 

The instrument consists of thirty-six sentence stems (e.g., 
"Raising a family --"); students are asked to complete the 
sentences. Responses to all thirty-six stems are independently 
rated as manifesting one of the levels represented in Table 2 
(codes are shown in the table), and then the distribution of 
ratings is used to estimate the level of core functioning 
manifest in the total protocol. The single total protocol rating 
is then used as a general index in the analyses of student 
outcomes. 



Moral Judgment InstrumGiit 
and Defining Issues Test 

Both measures stem from Kohlberg's theory of moral 
development, although the latter instrument was conceived by Rest 
(1979a) as more than simply an alternate test of the same 
characteristics. 

The descriptions of Kohlberg's stages and the complex scoring 
system have been undergoing extensive revision in recent years. 
The raost recent exposition of the theory and survey of the 
development and validation of the measure (Kohlbe'rg, 1981a, 
ISSIb) guided our use of the meas\ire. A scoring manual has been 
published (Colby et al., 1983). A subset of our 

students completed the Moral Judgment Instrument, and their 
responses were scored by John Gibbs, one of the authors of tho 
new ncorin^: :naiiual, and Clark Power, at flarv/ird'u (Winter for 
Moral Rduca t Lon. 

Ko h I b e r g ' ^^ i n s t r urn ^? n t pre n ( > n t; s i.) t ud e n t s w i. t }i i n c oin p 1 e t < ) 
3tori(?M that pose a mnvil dilemma, <\nd ank:i for oomplotLon of the 
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Table 2. 

Some Milestones of Ego Development 



Stage 



Presocial 



Symbiotic 



Impulse Control 1 
Character 
Code Development 



I-l 



Interpersonal 
Style 



Austistic 



Symbiotic 



Conscious 
Preoccupations 



Self vs. non-self 



Cognitive 
Style 



Impulsive 



1-2 Impulsive, 
fear of 
retaliation 



Receiving, 
dependent, 
exploitive 



Bodily feelings, 
especially sexual 
and aggressive 



Stereotypy, 
conceptual 
confusion 



Self-protective A 



Fear of being 
caught, 
externalizing 
blame, 

opportunistic 



Wary , 

manipulative, 
exploitive 



Self-protection, 
wishes, things, 
advantage, control 



onformist 



1-3 Conformity to 
external rules, 
shame, guilt 
for breaking 
rules 



Belonging, 
helping, 
superficial 
niceness 



Appearance, social 
acceptability, 
banal feelings, 
behavior 



Conceptual 
simplicity, 
stereotypes, 
clichds 



ionscientious 
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1-4 Self-evaluated 
standards, 
self-criticism, 
guilt for 
consequences, 
long-term goals 
and ideals 



Intensive, 
responsible, 
mutual, 
concern for 
communication 



Differentiated feel- 
ings, motives for 
behavior, self-respect, 
achievements, traits, 
expression 



Conceptual 
complexity, 
idea of 
patterning 



Table 2 continued. 



Impulse Control, 







Character 


Interpersonal Conscious 


Cognitive 


Stage 


LOQC 


Development 


^tyie Preoccupations 


Style 


Aut'onnmoiis 


I-S 


AflH * frinino ui 


Ann' Popnooh \/iiTi/ii\y />/^rtiTAifft/i 

rtuu. KtJspecL viviaiy conveyeQ 


increasea 






conflicting 


ivL auLUUUiiiy iccl iUgo j iutcglaLiUll 


lOIltcpLUaX 






innpr npprlc; 


OL pnysioiogicai ana 


compiexiLV, 








pbyLnoiogiCai, 


compiex 








psychological causa- 


patterns. 








tion of behavior, 


toleration for 








development, 


ambiguity. 








role conception, 


broad scope. 








self-fulfillment, 


objectivity 








self in social context 




Integrated 




Add: Reconciling 


Add: Cherishing Add: Identity 








inner conflicts, 


of individuality 








renunciation of 










unattainable 






Me. "Add" 


means in addition to the description applying to the previous level. 





Jane Loevinger & Ruth Wessler. Measuring Ego Devel opment, Volume 1. San Francisco: ,lossey-Bass, 
Inc., 1970. 
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story via ^ set of structured questions which probe the student's 
reasoning on moral issues. 

Rest created the Defining Issues Test as/ an objective measure 
of the degree of principled thinking students recognize in a set 
of "stage prototypic statements." Rest's description of moral 
development ■ stages / highlighting two major dimensions and a 
central concept important to his work, is presented in Table 3. 
The construction of the measure as an objective test- permitted 
computer scoring (Rest, 1979b). 

In our analyses and reports, we have utilized two indices, 
the "P^" score and the "D" score. The former is the most widely 
used general index from t^e instrument, and reflects the 
percentage of statements prototypic of principled thinking levels 
chosen by the student. The six stagej of development may be 
collapsed into three levels, two each at preconventional, 
conventional, and principled levels. 

The D score, created by Mark Davison (see Chapter 8 in Rest, 
1979a and Section 4 in Rest, 1979b), is mathematically more 
complex and, for all practical purposes, requires scoring by 
computer. The advantage of the D score is that it reflects the 
student' s relative preferences for principled thinking over 
preconventional and conventional thinking. The D score is 
reported along with the better known score in our work as a 
contribution to the ongoing evaluation of the relative merits of 
the two indices as a general purpose index. 



Test of Cognitive Development 



This instrument was inspired by the work of Inhelder and 
Piaget ("958) and is more narrowly focused on a single stage of 
cognitive development, formal operations, than are the preceding 
measures. Piaget 's four major stages of the development of 
intelligence are sensori-motor , p re-ope rational, concrete 
operations , and formal operations. Formal operations involve the 
ability to reason with propositions and hypotheses. 

Although several problems from different sources were 
experimented with in our studies, the results reported here were 
based upon a five item set prepared by Renner, Fuller, Lockhead, 
and Johns (1976). This set included two experiments in 
proportionality (shadow length, arm balance), two in conservation 
of volume (cylinders, water in bottle), and one on separation of 
variables (flexibility of rods). The scoring key was prepared by 
George Klemp of McBer and Company. 

Generic Ability Measures 

The seven instruments described below do not all measure 
abilities in the strict sense; the phrase has been employed 
broadly to distinguish a set of ability, motivation, cognitive 
s tyle, and other personal charac teristic measures from the 
preceding set of measures derived from developmental theory. 
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Table 3 • 



Stages of Moral Judgment 



Coordination of expectations Schemes of balancing Central concept for 

about actions (how rules interests (how equilibrium determining moral rights 

are known and shared) is achieved) and responsibilities 



The caretaker makes knouTi 
certain demands on the 
child's behavior. 



The child does not share in 
making rules, but understands 
that obedience will bring 
freedom from punishment. 



The morality of obedience: 
"Do what you're told." 



Stage 2 Although each person is 
understood to have his 
own interests, an exchange 
of favors might be 
mutually decided. 



If each party sees something 
to gain in an exchange, then 
both want to reciprocate. 



The morality of instrumental 
egoism and simple exchange: 
"Let's make a deal." 



Stage 3 Through reciprocal role 

taking, individuals attain 
a mutual understanding 
about each other and the 
on-going pattern of their 
interactions. 



friendship relationships 
establish a stabilized and 
enduring scheme of cooperation. 
Each party anticipates the 
feelings, needs, and wants of 
the other and acts in the 
other's welfare. 



The morality of inter- 
personal concordance: "Be 
considerate, nice, and kind, 
and you'll get along with 
people." 



Stage 4 All members of society 
know what is expected 
of them through public 
institutionalized law. 



Unless a society-wide system of 
cooperation is established and 
stabilized, no individual can 
really make plans. Each person 
should follow the law and do 
his particular job, anticipating 
that other people will also 
fulfill their responsibilities. 



The morality of law and duty 
to the social order: 
"Everyone in society is 
obligated and protected by 
the law." 



4o 
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Table 3 continued. 



Stage 



Coordination of expectations Schemes of balancing 
about actions (how rules interests (how equilibrium 
are known and shared) is achieved) 



Stage 5 



Formal procedures are 
institutionalized for 
making laws, which one 
anticipates rational people 
would accept, 



Stage 6 The logical requirements 
of non-arbitrary coopera- 
tion among rational, 
equal, and impartial people 
are taken as ideal criteria 
for social organization 
which one anticipates 
rational people would 
accept, 



Law-making procedures are 
devised so that they reflect 
the general will of the people, 
at the same time insuring 
certain basic rights to all. 
With each person having a say 
in the decision process, each 
will see that his interests 
are maximized while at the same 
time having a basis for making 
claims on other people. 

A scheme of cooperation that 
negates or neutralizes all 
arbitrary distribution of 
rights and responsibilities 
is the most equilibrated, for 
such system is maximizing the 
simultaneous benefit to each 
member so that any deviation 
from these rules would advantage 
some members at the expense 
of others. 



Central concept for 
determining moral rights 
and responsibilities 



The morality of societal 
consensus: "You are 
obligated by whatever 
arrangements are agreed to 
by due process procedures." 



The morality of non- 
arbitrary social coopera- 
tion: "How rational and 
impartial people would 
organize cooperation is 
moral." 



The Picture Story Exercise, Learning Style Inventory, and 
Adaptive Style Inventory are not measures of ability; the 
remaining measures group into one set of three which do measure 
aspects of analytic ability, and one which was designed to 
measure a component of human relations ability. 



Pictur e S tory Exerc ise 

Several cognitive, motivational and emotional variables have 
been derived from this instrument. It is one of several 
modifications of the Thematic Apperception Test first developed 
by Henry Murray (Morgan A Murray, 1935) that have been devised by 
McClelland and others to study motivation and personality 
variables in non-clinical settings. The present application is 
described by Winter, McClelland & Stewart (I98I). Along with two 
of the analysis measures introduced below, this instrument is 
marketed by McBer and Company as the Cognitive Competence 
Assessment Battery . 

The variables derived from the Picture Story Exercise in our 
study included Stewart's four Stages of Adaptation (l977b), 
Self-Definition (Stewart & Winter, 1974), and the three motive 
variables of Achievement (McClelland et al., 1953), Affiliation 
(Atkinson, 1958) and Power (Winter, 1973). 

Stewart's stages of psychological adaptation to the 
environment were derived from Freud's oral, anal, phallic, and 
genital stages of psychosexual development. Stewart associated 
four behavioral categories with these stages: receptive, 
autonomous, assertive, and integrative, respectively. Table 4 
displays the content areas and behaviors found in students' 
responses on the Picture Story Exercise which were scored for 
Stages of Adaptation. 

Unlike the cognitive-developmental stage measures presented 
above, a separate score was given for each stage. While 
composite or model stage scores are possible, the four raw scores 
were all included in the present analysis. 

The Self-Definition variable was developed by Stewart and 
Winter (1974) on the basis of differences in Picture Story 
resporses between women who planned on full-tirue careers after 
college and those who planned on marriage and family. 
Behaviorally, Self-Definition (equated with planning full-time 
careers) was scored on the basis of cause-effect relationships 
and instrumental action considered in students' imaginative 
stories. A higher score indicates more evidence of 
Self-Def inition . 

The motivation variables each have independent scoring 
schemes which are applied to the same stories evaluated in termi3 
of Stages of Adaptation and Self-Definition. Briefly, the 
Achievement motive score is a measure of a student's concern with 
doing something well, according to some standard of excellence. 
The Affiliation motive score represents a concern with 
relationships and nurture. Power motivation is to be understood 
as a concern for having impact on others. 
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Table 4. 



Four Stages of Adaptation 



Content Areas and Behaviors 



Content Areas 



Attitude toward Relations with Feelings 
authority others 



Orientation to 
action 



Receptive 



Authority is 
benevolent 



Imediate Loss, despair, 

gratification confusion 



Passivity 



Autonomous 



Authority is 
critical, 
reprimanding 



Lack of 
gratification 



Auxiety about 
competence 



Clearing of 
disorder 



Assertive 



Opposition to Flight and Hostility, 
authority exploitation anger 



Failure, in context 
of confident 
attempt 



Integrative 



Authority 
is limited 



Mutuality, 
sharing 



Ambivalence 



Work commitment 
and involvement 



Me. Abigail J. St?.wart. "The course of individual adaptation to life changes.' 
Journal of Personality and Social Psychology , 1982, 42(6), 11004113. 
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Each of these concepts and scoring schemes have been 

described in relation to measuring outcomes of liberal education 

in a new case fojr the liberal arts (Winter, McClelland & Stewart, 
1981). 



Learning Style Inve n tory a nd 
Adaptive Styl e InverTtory 

The Learning Style. Inventory instrument was designed to 
measure learning style preferences derived from experiential 
learning theory as formulated by Davia Kolb (in press). Figure 1 
displays the four stage learning cycle. The idea of development 
here is decidedly not one of progressive stages as in the 
cognitive-developmental theories and measures presented earlier. 
This model is dialectic, following Jung's (1923) notion that 
fulfillment in adult development is accomplished by higher level 
integration and expression of nondominant modes of dealing with 
the world" (Kolb, 1976). 

The four stage cycle reduces to two primary dimensions of the 
learning process: one involving tension between active and 
reflective modes, and the other involving tension between 
concreteness and abstraction. Theories of cognitive growth 
generally suggest movemont from concreteness to abstraction, and 
action to reflection, from the perspective of developing 
abilities. This model focuses on differences in adult learning 
style or characteristic functioning assuming the two pairs of 
polar opposites exist to oppose each other. 

The instrument is a nine item self-report questionnaire. 
Each item requires the student to rank order four words in a way 
that best describes her learning style. One word in each item 
corresponds to the four stages of the learning cycle. Rankings 
determine scores such that higher scores indicate greater 
preference . 

Composite scores for the two dimensions, Active/Reflective 
and Abstract/Concrete, are computed by subtracting the latter 
from the former score. All six indices were included in our 
analyses. 

The Adaptive Style Inventory (Kolb, 1978) was designed in 
part to address criticisms of- the Learning Style instrument and 
also to bring within the scope of the measure situational 
variability (Gish, 1981 ) . The instrument was included midway 
through our longitudinal study so our data are incomplete. We 
have included comparison data, however, for the purposes of 
contributing to the validation of the new measure and as a source 
of cross-validation of the learning style outcomes. 



Test of Thematic Analysis 
and Analysis of Argument 

These instruments are described as new measures of 
intellectual abilities which are expected to develop through 
liberal education. The Test of Thematic Analysis (Winter 
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Concrete 
Experience (CE) 

• Experience-based 
approach to learning 

• Feeling-based judgments 

• People oriented 



Active 

Experimentation (AE) 

•Active, doing approach 

to learning 
• Involvement with activities 

that test one's ovm 

knowledge and ability 



LEAf^NING 



MODES 



Reflective 
Observation (RO) 

•Tentative, impartial, 
reflective approach to 
learning 

• Preference for role of 
observer rather than 
participant 



Abstract 

Conceptualization (AC) 

• Analytic approach 
to learning 

• Logical, rational 

• Orientation towards 
things and symbols 



Figure 1. The Experiential Learning Model. 



Note. David A. Kolb. Learning Style Inventory: A Self 
Description of Preferred Learning Modes . Boston : 
McBer & Co . , 1977. 
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McClelland, 1978) is a measure of critical thinking similar in 
form to the traditional "compare and contrast" essay familiar to 
all college students and teachers. The scoring of the students' 
work is designed to tap the ability to form complex concepts and 
communicate them. Higher scores indicate more evidence of this 
ability (Winter, 1976) . 

The Analysis of Argument (Stewart, 1977a) is intended to 
assess intellectual flexibility by requesting the student to 
argue against a controversial opinion, and then defend the 
opinion just attacked. Separate scores are given for the first 
argument attacking the presented opinion, and for the second 
..argument defending it. Higher scores for the attack argument 
•^ndicate more evidence of central organization and focus on the 
logic of the position. Higher scores for the defense accrue to 
evidence of modified endorsement or acceptance which does not 
contradict the attack argument. 

/ The scoring systems for both the Test of Thematic Analysis 
and the Analysis of Argument provide for negative scores. The 
scoring keys were devised by comparing elements common to essays 
of seniors and elements common to essays of freshmen. The former 
earn positive marks and the latter earn negative marks. In the 
case of forming complex concepts, negative scores are given for 
"apples and oranges" comparisons, and for affective or subjective 
reactions. In the case of the flexibility measure, negative 
scores are given for stringing together criticisms in the attack 
in an unorganized fashion, and for focusing on facts and 
counter-fa'" cs rather than on logic. Negative elements in scoring 
thfc defense include simple reversal to total endorsement of the 
position just attacked or proposing new arguments not even given 
in the original opinion. 



Wa tson- Glaser Critical 
Th j.nking Appra isal 



This is a traditional and time tested measure of critical 
thinking abilities (Watson & Glaser, I964). Three of the five 
subtesL^ were administered: the fi^st. Inference, assesses the 
ability distinguish degrees of ruth or falsity of inference 

drawn from data. Second, Recogni tio.i, assesses the ability to 
recognize unstated assumptions or presuppositions in given 
assertions. Third, Deduction, assesses deductive reasoning. 

Not used were two subtest., assessing ability to weigh evidence 
and ability to evaluate arguments. 



Li fe Hi story Ex ere ise 

The three measures just presented all focus on elements of 
analytic ability. Only the Life History Exercise (Klemp 5 
Connelly, 1977) was specifically designed tu measure human 
relations ability. The instrument wars in the early stages of 
development when longitudinal study began, so as with Kolb's 
Adaptive Style Inventory, our data are incomplete. 



The instrument is still under development by McBer and 
Company (winter, McClelland & Stewart, 1981 )• The Alverno data 
will contribute to the interpretation and refinement of this 
instrument. 



Research Design 



The research design specified both a cross-sectional 
comparison of entering and graduating students, and a 
longitudinal study of two consecutive entering classes. 
Longitudinal data collection began with the class entering in the 
fall of 1976, In the fall of 1977, the college inaugurated a new 
weekend time-frame for women unable to attend during the 
traditional weekday time-frame. The research plan was amended to 
include women entering the new Weekend College program as a third 
entrance cohort; the longitudinal data reported reflect this 
amended data structure. For the cross-sectional comparison of 
entering and graduating students, data were collected on students 
graduating in the spring of the 1977-78 academic year. The 
1977-78 Weekday College entering class, which was participating 
in the longitudinal study, provided the comparison group for the 
cross-sectional study. Table 5 presents the overall design for 
the administration of the human potential measures against a 
common time-line. 

The conventional procedure for cross-sectional comparisons is 
to assess two or more groups at the same point in time. This 
procedure was slightly modified in the present study because of 
conflicting time and design requirements of the longitudinal and 
cross-sectional data collection strategies. Given circumstantial 
limitations, comparison of entering and graduating groups in the 
same academic year best approximated coincidence of time (actual 
assessment times were seven months apart). While on the one hand 
uhis adjustment was a practical accomodation of conflicting 
schedule requirements, it is worth noting that the data more 
accurately represent the desired comparison than would a 
"correct'* cross-sectional design, since students do not typically 
enter and graduate at the same point in time. 



Selecting the Cross-Sectional Sample 

Among the validity issues of cross-sectional designs, two 
were of special concern in the present study. Both involved 
judgments in selecting an entering class comparison group. The 
first problem derived from the inauguration of the Weekend 
College in the fall of 1977. This raised the possibility of 
changes in recruitment activity and/or student self-selection 
vfith respect to students entering the traditional weekday 
time-frame that year^- which might affect the comparability of 
that group with the graduating group. The second problem was 
that of matching groups for comparison on multiple measures. 
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Table 5. 



OesiRH for tl,e Adniinistration of Huoian Potential Measures and Student Percention 
Measures for Lonrini<lin.i n. ,. . . . lerception 



Entrance 
_Coliort 

1976 

Weekday 

College 



HPM 

SPI 
AS 



1977 

Weekday 
College 



I I 



i ?! 

I 

I <w'' 

j 

I 



C 
I 

M 



1977 

Weekend 

College 

1972/73 
Weekday 
College 
(Pilot) 

1973/74 
Weekday 
College 



HPM/HPM 
SPI/SPI 
AS 





Academic Year 




1977/78 


i J/0/ /y 


1 m n /ha 

1979/80 




HPM 


HPM 


SPI 


SPI 


SPI 


AS 


AS 


AS 


/ 










..../ 




SPC "~ 


fpc: 


HPM 




HPM 




SPI 


SPI 


AS 


no 


AS 







Trc 

i, IN 




SPC 


SPC 


HPM 




HPM 


SPI 


SPI 


SPI 


AS 




AS 



1980/81 



Careering 
Follow-up ~^ 



HPM 
SPI 
AS 
CO 

7 

IIPM 
SPI 
AS 



Careering 
Follow-up 



HPM/HPM 

SPI/SPI 
AS 
SPC 



Careering 
Follow-up ^ 
SPI 

„ — , CO 

Chararteristics (SPC), 



o 5v3 
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The inauguration of Weekend College in the 1977-78 academic 
year posed the potential problem of recruitment and selection 
differences between the Weekday College groups represented by the 
graduating students (who entered before there was a Weekend 
College) and the new entering students (who entered the Weekday 
College as opposed to the new Weekend College). The decision to 
compare 1977-78 graduating students with students entering the 
Weekday College in the fall of 1977 was finally based on three 
factors. First, there was an a priori determination that the 
mutually exclusive time-frames of Weekday and Weekend Colleges 
were not interchangeable options for most students. Recruitment 
for the new Weekend College was specifically targeted for women 
who were not able to attend classes during the week. No new 
recruitment policies were initiated with respect to the 
traditional weekday time-frame. It was not unreasonable to 
presume that women who were able to attend weekday classes would 
not choose the weekend time- frame. 

The other two factors, more empirical in nature, supported 
this presumption. Distributional statistics compiled on student 
background and personal characteristics of students entering the 
Weekday College in 1977 were not dissimilar to previous entering 
classes, and were different from those of the first Weekend 
College entering class. This can be seen in the statistical 
description of the three entrance cohorts participating in the 
longitudinal study. The 1977 Weekday College entrance cohort was 
much the same as the 1976 Weekday College entrance cohort, and 
both were different than the 1977 Weekend College entrance 
cohort. (See Tables 9 through 16.) And finally, in subsequent 
years of the longitudinal study, it was confirmed that very few 
students transferred between Weekday and Weekend time-frames in 
either direction. In summary, the Weekend College attracted a 
new population of students, and its advent did not seriously 
affect the composition of Weekday College in relation to previous 
entering classes. 

The second problem, matching entering and graduating groups, 
arises from the fact of attrition. It is normally assumed that, 
among other reasons, students drop out of college before 
graduating because they are less able, or at least less 
academically successful, than peers who go on to graduate. When 
comparison groups are not pre-selected on the basis of matched 
ability, relevant ability-level characteristics are normally 
statistically controlled in the data analysis phase. This 
practice is a partial solution, but does not directly address the 
problems posed by attrition. In the present study, the fact that 
longitudinal data were being collected on the 1977 entering class 
permitted a novel solution: matching groups on the gross 
behavioral criterion of persistence. That part of the 1977 
entering class which persisted through the three and one-half 
years of the longitudinal study was selected as the entering 
student group to compare with the graduating students. As is 
reported in the data analysis section, comparisons on particular 
outcome measures were further controlled fo r differences in 
background or ability where necessary. 
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Collecting the Longitudinal Data 



The three entrance cohorts involved in the longitudinal study 
were assessed on three occasions: at entrance, two years after 
entrance, and three and one-half years after entrance, ^Fhe goal 
was to collect outcome data on all students entering in 1976 and 
in 1977, rather than depend on random sampling. The actual 
procedures of data collection are detailed in the following 
section. The overall success of the data collections is shown by 
the percentages of students assessed in Table 6, Overall, 927 
of the eligible student population took part in the entrance 
assessments. Only a small subgroup of older, part-time students 
in the Weekday College time-frame were under- represented in the 
entrance asses3ment3. Of the students from these entrance 
cohorts who were enrolled at the time of the second assessment, 
^H)\ participated; the corresponding figure for the third 
assessment was Tne losses in absolute numbers from first 

to last assessment were due almost entirely to attrition rather 
than non-participation of eligible students. 

Stated positively, we have confidence in the 
representativeness of the data for women attending Alverrio during 
the study period. This does not of course affect the limits on 
generali^.a J Llity beyond Alverno College, nor to later Alverno 
populations. The latter qualification must be emphasized 
particularly in the case of the Weekend College entrance cohort, 
as this group may possess some unique characteristics by virtue 
of being a "pioneer'* class for the new time-frame. 

No attempts were made to assess students who were not 
enrolled at the time of the second or third assessments. There 
were group differences between those that persisted and those 
students , who left. These differences can be reviewed in Tables 
A, B, and C of Appendix I, The longitudinal data analyzed for 
this report include only those students who participated in all 
three assessmen ts. 



Descriptions of Student Cha r a c teri sties 
and Program Variables 



Several personal and background characteristics that are 
commonly identified as important input variables in studies of 
educational outcomes were, in the present case, not variables at 
all, but rather population descriptors. An obvious example is 
the variable of sex; in the present study, all of the students 
were worn en- 

Other population descriptors which limit generalizability 
include race, geographic origin, work experience, basic skills, 
and off-campus learning experiences during college. While some 
minority and out-of-state students do attend Alverno, their 
numbers were proportionately very small. On average, about 35% 
of Alverno* s students were Caucasian and resided in the 
southeastern region of Wisconsin before entering college. 
Students were from a range of urban and rural areas. Virtually 
all had some type of work experience, including the traditional 
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Table 6. 



Number and Percentage of Eligible Students Participating 
in the Longitudinal Study 



1976 IJeekday 1977 Weekday 1977 Week'end"" 

- --ii".Jii£i_.„ College ' „_Colleje 

Fliiublc Percent Eligible Percent' Eligible Percent 

'\ssessed Students Assessed Students Assessed 



1 


237 


87.7 


222 


90.0 


270 


99.3 


2 


89 




101 




Ul 


91./^ 


3 


72 


95.5 


100 


93.0 


85 


92.9 
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age students who entered directly from high school. Less than 
10^^ came to Alverno identified as in need of assistance with 
basic skills. Due to Alverno's broadly institutionalized 
commitment to experiential learning, virtually all students 
participated in some type of supervised off-campus learning as 
part of their college program. 

In various studies of more heterogenous student populations, 
all of these characteristics have been cited as accounting for 
differences in educational outcomes. 

It should be noted that while these parameters are 
limitations for the purposes of general izab il ity, they are just 
as much advantages for the purposes of validation and exploration 
of the effects of the Alverno college experience. Analogous to 
the manner in which the study of ti^ins carries special weight in 
"nature-nurture" investigations, the relative homogeneity of the 
Alverno student population serves to eliminate several common 
alternative explanations for observed differences in educational 
outcomes. 

Tables 7 through 20 present characteristics of the student 
population which were later analyzed as input variables in 
relation to the selected outcome measures of human potential. 
Tables 7 and 8 describe comparable background characteristics of 
the entering and graduating student groups employed for the 
c ross-sec tional st udy . 

^ Age and marital status are given at the time of assessment. 
Both groups include a comparable proportion of older students. 
For both theoretical and practical reasons, academic performance 
in high school, indexed by grade average, was treated as a 
categorical rather than interval variable. On the practical 
side, differences in transcript recording systems from high 
schools made it difficult to assign an accurate decimal 
equivalent. On the theoretical side, two factors were taken into 
consideration. First, the variance in time elapsed between high 
school and college for older versus traditional age students 
probably precludes the comparability of grade points as an index 
of current academic ability. Second, the outcome measures of 
this study were not traditional measures of academic ability, and 
thus the usual correla: lon of past with present indices of 
academic ability would not be expected to apply. We anticipated 
that, in relation to the selected measures of human potential, 
the high school grade variable might function more as a 
self-classification of ability than as a measure of actual 
differential ability on a common interval level scale. In any 
event, high school grade was recorded and treated as a 
categorical variable. 

Religion and parent's occupation and education are not shown 
for the cross-sectional comparison groups, but are included in 
Tables 9 through 13 for the longitudinal cohorts. As is 
indicated later in the results section, almost none of the 
outcome measures were significantly correlated with these 
variables for the Alverno student population. These 
characteristics are included in the description of the 
longitudinal cohorts as additional evidence for the proportional 
continuity and representativeness of the longitudinal cohorts 
through loss of eligible student participants. 
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Table 7. 



Age and High School Grade Point Average Distributions 
for the Cross-Sectional Study 



1978 Weekday 
Graduating Students 



Age at Assessment High Scho ol Grade Point Average 
M SD Missing "D" "C" "B" "A" 



Traditional 
(n = 45) 



21.2 0.57 



4.4 



00.0 4.4 55.6 35.6 



Older 

(n = 15) 



33.5 8.69 



13.3 



00.0 33.3 33.3 20.0 



1977 Weekday 
Entering Students 



Traditional 
(n = 60) 



17.7 0.55 



13.3 



00.0 10.0 55.0 21.7 



Older 

(n = 17) 



29.5 9.24 



23.5 



5.9 35.3 35.3 00.0 



Table 8. 

Prior College Experience anc Marital Status Distributions 
for the Cross-Sectional Study 



Prior College Experience 
None Some More 



1978 Weekday 
Graduating Students 



Marital Status at Assessme nt 

Divo rced / 
Single Married Widowed 



Traditional 
(n = 45) 



97.8 



00.0 



2.2 



84.4 



11.1 



4.4 



Older 

(n = 15) 



53.3 



20.0 



26.7 



13.3 



80.0 



6.7 



1977 Weekday 
Entering Students 

Traditional 

(n = 60) 95.0 1.7 3.3 100. 00.0 00.0 

Older 

(n = 17) 35.3 5.9 58.8 47.1 41.2 11.8 
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Both cross-sectional groups and longitudinal cohorts are 
further divided into two age cohorts. Although the investigation 
of differenceiD between traditional age and older student groups 
was not a specified objective of the study, we have made use of 
this categorization at several points to examine and present 
differences between these two groups. 

Tables 9 through 16 describe the background characteristics 
of the longitudinal cohorts. Age at entrance is shown for both 
second and third assessments, rather than age at assessment, to 
more clearly indicate what changes occurred in subgroup 
composition over time. Marital status was of course the one 
"background" variable that cc^^ld and did change for some students 
during college. This fact was accomodated in the table by 
columns indicating two categories of changed status at the time 
of the second and third assessments. 

The Time 3 figures in each column represent the 208 cases 
analyzed in the longitudinal study. Each of the individuals 
represented completed one or more instruments on all three 
occasions of assessment; most completed all instruinents (except 
for Kohlberg's Moral Judgment Instrument, which was purposely 
administered to a smaller subsample). 

Extensive analyses of the interrelationships among input 
characteristics divulged several strong correlations and 
clustered subsets, indicating definite student "types" in the 
population. Dominant patterns in the data characterized two 
major student types. First, what might be called the traditional 
student. She was 17-19 years old at entry, and identified 
herself as Catholic and single on her college application. Her 
parents were high school graduates, and in some cases have 
post-secondary education; they were often employed in 
professional, technical or managerial occupations. She was an A 
or B student in high school and entered Alverno with no prior 
college experience. The second type was older, but this^ age 
ranged over 35 years, from 20 to 55. The students in this 
category were about half Catholic and half Protestant or 
unidentified. The typical older student was married, some were 
divorced or widowed. Her parents had less education than the 
traditional student and worked in service occupations or skilled 
trades. She did less well in high school, and entered Alverno 
with some prior post-secondary experience. 

Tables 17 through 20 show college-level inputs taken into 
account in examining the effects of the general Alverno College 
experience on outcome measures. As with the background 
characteristics, definite patterns of inter- relationships 
existed, and the patterns of college experience input 
characteristics were related to background patterns as well. The 
traditional age student was enrolled in the Weekday College 
program, and was more likely to be a full-time s-tudent and live 
in the residence hall. She was most likely a Nursing student. 
The older student was more likely to be enrolled in the Weekend 
College program, and was more likely to attend part-time and to 
commute. During the period of the study, three majors were 
offered in the Weekend College: Behavioral Sciences 
(Management), Communications, and Nursing. The majority of 



students majored in Management, 



39 



63 



EKLC 



Table 9. 



Age, Race and ReliRion Distributions across Occasions 
for the Longitudinal Study 



SD 



1976 Weekday Colle ge 

Tl Traditional 
{n=l20) 
Older 
(n=88) 

T2 Traditional 
(rt=60) 
Older 
(n=24) 

T3 Traditional 
(n=A8) 
Older 

1977 Weekday C ollej;e 

Tl Traditional 
(a=133) 
Older 

T2 Traditional 
(n=77) 
Older 
(n=24) 

T3 Traditional 
(n=60) 
Older 
(0=17) 

1977 Weekend C ollege 

Tl Older 
(n=268) 

T2 Older 
(n=l29) 

T3 Older 
(D=72) 



17.9 0.62 
32.9 8.75 



17.8 0.60 
30.4 7.31 



32.9 7.89 



Age 
M SD 



17.9 0.60 
30.1 9.10 



17.8 0.60 
29.2 8.10 



32.8 7.54 



SD 



17.8 0.56 

30.9 10.5 



17.7 0,55 
29.5 9.24 



31,3 7.02 



Race 



7. Caucasian 



95.0 

88,6 



95.0 
87,5 



95.8 
100. 



94.0 
92.5 



96,1 
95.8 



98.3 
100. 



88.4 



87.6 



Religion 
X Catholic 



74.2 

50.0 



70.0 
37.5 



75.0 
54.5 



66.9 
56.7 



67.5 
58.3 



73.3 
64.7 



51.9 



51.2 



52.8 



ERIC 




Table 10. 



Mothur's Kduc;itlon Distributions across Occasions 
for the longitudinal Study 



Miss lay, 



1976 W eekday College 
Tl Traditiotial 

(n=l20) 
Older 

(n^88) 

T2 Traditional 
(n:60) 
Older 
(n=2M 

T3 Traditionjl 
(11=48) 
Older 
(nMl) 



12.5 



6.7 
25.0 



6.3 
18.2 



Mother's Education 



Prlraary 



il. S. 



Post a.s. 



10.0 
20.5 



13.3 
16,7 



10.4 
18.2 



48.3 

29.5 



50.0 
33.3 



47.9 
45.5 



16.7 
11.4 



20.0 
16.7 



22.9 
9.1 



GrauuaCt 



12.5 
3.4 



10 

8.3 



12.5 
9.1 



197 M*eekdajr^l 1 ego 

Tl Traditional 
m=133) 
Older 
(n=67) 

T2 Traditional 
(11^77) 
Older 
(n=24) 

T3 Traditional 
(n=60) 
Older 
(r.--17) 

1977 Weeken d Co 11 eje 

r3 Older 
(n=72) 



17.3 

23.9 



14.3 
12.5 



13.3 

11.8 



5.6 



7.5 

23.9 



9.1 

33.3 



10.0 
29.4 



33.3 



44.4 

34.3 



44.2 
33.3 



46.7 
35.3 



41.7 



15.8 
9.0 



15.6 
8.3 



13.3 
5.9 



11. 



15.0 
9.0 



16.9 
12.5 



16.7 
17.6 



fi.3 
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r,-M.- 11. 

Fatiu-r's K'.l'.jL .Rifir. Disirilnit ions ii-ross (i.'iMsldtis 
for tn<> l.on^'.ltiuilivi! Study 

_£,ijju.'rJs_^ur_;i_t:J_o_n 

Missing Frinarv H. S. I'osc U.S. rnuluato 



21.7 10.0 35.8 15.0 17.5 



]9 7 6 Weekday Col leje 
TI Traditional 

Older ^^.5 20,5 20.5 4.5 9.1 



(n=8B) 

T;'. Trad It! una 1 U 
(11-60) 
Older 



10.0 40,0 18.3 18.3 

31. J 20.8 37.5 0.0 8.3 



0 



(n--Z4) t 
T3 TradUional 12,5 8.3 35.4 20,8 22.9 

Older 27.3 IB. 2 36.4 0.0 18. 

(n=n) 



19/7 Weekday Col lege 

T' Traditional 195 14.3 30.8 !8.0 17.3 

(n^l53) „ , 

OLd.i 25. 26. 25.6 11.9 10,4 



T2 Traditional 19,5 
(11^77) 

Older 20. h 

(n:^24) 



1.'^.) 41. (, 14.3 10.4 

20.8 37,5 12.5 8.3 



T3 Traditional 16.7 !5.0 43,3 11.7 13.1 

(n=60) 



Older 

(n:^17) 

19/7 Weekend Co nt^e 

T3 Older 
(n^72) 



17.6 2.3.5 35. i 11.8 



5.6 14,7 25.0 25.0 9.7 
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Tablt' 12. 



Mother's Occvipation Dls tr ibuc Ions ncross Occasions 
for Lhe Loii(4' fudlnnl Study 



1976 Weekday Co llege 

Tl Traditional 
(n=120) 
Older 
(n=88) 

T2 Traditional 
(n=60J 
Older 
(n=2A) 

T3 Traditional 
(n=A8) 
Older 
(n=ll) 



Missinjj 



!0.0 
20. ■) 



b.7 

16.7 



6.3 
9.1 



Mother ' s_Occupati_on_ _ 
Level 1 Level 2 Level ^ Level 5 



18. J 



21.7 
12.5 



25.0 
9.1 



21.7 
U.A 



23.3 

16.7 



22.9 
18,2 



42.5 
34.1 



41.7 
37.5 



37.5 
54.5 



7.5 

18.2 



6.7 

16.7 



8.3 
9.1 



1977 Weekday College 

Tl Traditional 
(n=133) 
Older 
(n=67) 

T2 Traditional 
(n=77j 
Older 
(n=24) 

T3 Traditional 
(n=60) 
Older 
(n=17) 

1977 Weekend College 

r3 Older 

{n=72) 



10.5 
11.9 



7.8 
4.2 



6.7 
5.9 



16.7 



19.5 
10.4 



24.7 
20.8 



23.3 

i:'.6 



2.8 



16.5 
13.4 



15.6 

25,0 



16.7 
35.3 



20.8 



49.6 
40.3 



49.4 
41.7 



50.0 
29.4 



59,7 



3.8 
23.9 



2.6 
8.3 



3.3 
11.8 



0.0 



Note, 



Occupational categories at ca-, level include: 1) Professional, technical, managerial; 
2) Clerical, sales, service; .0 Farming, manufacturing trades; 4) Homekeeper ; 
5) Miscellaneous ' 
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F.iclu't'-- Ol i viiMti'^r. 1)] -it ritujt ioi-.s ,ut<"^s UiTasions 
;'ur the Lv-:u!l irn 1 st'idv 



Kalhfr's Octupjluiii 
Missing I.pvel 1 '-^vel 2 J l-f^"".! _> 



19 76 Wee kday College 

Tl Traditional l^*.: 1^- ^6.7 8. J 



(n=ftH) 
1 Traill 1 1 una 1 
1 '.Iff 



8.3 !^ T 3^.-3 3 7.5 



T» Tr,i.iUion.il 10.4 ^.1.8 U . f> „ 4. 2 



iil.lt-r 



9.1 9.1 0.0 3b. 4 



1 Wet'kdjy College 

it Tr.idi' Loii.il 10.'; ^l-^ l6,5 27.8 '3.8 

I'ii.lfi- 9.0 20.9 'J.O io.'!* 4A.B 

in-fc7) 

rj Tr.niitional :.!J 3^.0 U.: 1^') 

8.3 20.8 S.3 2S.0 

T i rra.lUiondl 3 i . J 23 , J i >. 1 1 . " 

U=bO) 

01, '..r 5.9 29.4 1 1.8 23.^ 29.^ 

19 v^fpttend Co I j^g^e 

T3 Older 111 20. fl l'^^ 50.0 2.8 

ln-72) 



.Sore, Oroip.itional catt■^orto3 at *',ich level iiulude; 1' Prof os.Monai , Lochnical, roanaperlal; 
">) Mlsc«'lia.neon3 
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Table 14. 



ERIC 



lllrh Schtjol rradt> Distributions ai^ross Occasions 
tor the Longl tucitnal Study 



n7t> Weekday Col lege 

11 rudiljoiiai 

Oi.ler 
(n=88) 



M 5 s s I n g 
D.itd 



JO. ') 



Hi^h School Grade J'ojiil Aver igf 



Ave rajje 



0.0 

::.3 



"C" 
Averagf' 



12.5 

11. 1 



Average 



52. b 
46.6 



"A" 
Ave£age 



20.8 
8.0 



Trad 1 1 lona 1 

(r.::60) 
Older 



18.3 
1(>.7 



0.0 
0.0 



0.0 
16.7 



58.3 
5^.2 



23.3 
12.5 



T \ T rad 1 1 1 ona I 
(n:^A8) 
Older 



16.7 
9.1 



0.0 
0.0 



0.0 
27.3 



60.4 
45.5 



22.9 
18.2 



Weekday Co I lege 



Tl Traditional 
(n-1 U) 
•Mder 

< n-b 7 ,) 



32,8 



0.0 
6.0 



15.8 
28.4 



49.6 
28.4 



18.8 
4.5 



rj Tr j<ht lona I 
^n=77 ) 
i>ld*«r 



n.o 

33,3 



0.0 

4.2 



10.4 
33.3 



57.1 
29.2 



19.5 
0.0 



Tl 



T3 Traditional 
ln=60) 
Older 
Ui-17) 

Wfekt'iid Col leg^e 

'.Mdrr 
( ri-2t)H ) 



13.3 
23.5 



1 1 2 



0.0 
5.^J 



10.0 
35. 3 



30.2 



55.0 
35.3 



45. S 



21.7 
0.0 



10.8 



r; Older 

(n 129) 



10. 1 



3.9 K.'' 33.3 



^1.9 



10.9 



IM ulder 

(n-*72) 



8. \ 



5 .b 



:*5 .8 



12.5 



6 J 



Table 15, 



Prior College Exporlenco Distributions across Occasions 
for the Longitudinal Study 



Pr ior Co 1 J^e^e^Expe^r ience 

No Prior 1-12 Credits 13 + credits 



1976 Weekday College 

Tl Traditional 85.0 5.8 

(n^l20) 

Older 42.0 18.2 

(n^88) 

T2 Traditional 88.3 1.7 

(n=60) 

Older 33.3 16.7 

(n-24) 

T3 Traditional 93.8 0.0 

(n=48) 

Older 2/. 3 18.2 

(n^lD 

Tl Traditional 90.2 3.8 

(n=133) 

Older 34,3 19.4 

(n=67) 

T2 Traditional 88.3 3.9 

(n:=77) 

Older 33.3 12.5 

(n-24) 

T3 Traditional 95.0 1.7 

(n:^60) 

Older 35.3 5,Q 

(n:::17) 

^ V. 7 Weekend Col l e ge 

Tl Older 32.5 15.3 

(n=268) 



T2 Older 33.3 
(n=:129) 

T3 Older 38.9 
(n=72) 



19.4 



23.6 



70 



9.1 
39.8 



10.0 
50.0 



6,3 
54.5 



6.0 
46.3 



7.^; 

54.2 



3 . 3 
58.8 



52.2 



47.3 



37.5 



Table 16. 



Marital Stains Distributions across Occnslons 
for the I.l'n^;l tudinal '^tudv 



l976_W eeKday Collect? 
fl Traditional 

{n=120) 
Older 

(n-88) 

T2. Traditional 
(n=60) 
Older 
in-lU) 

T3 Traditional 
(n=i8) 
Older 
(nMl) 



Single 

100. 

27,3 



Married 



98.3 
37.5 



89.6 



0.0 
63.6 



0.0 
45.8 



0.0 

45.5 



fliirltal fitatub 

Divorced/ 
Widowed 



0.0 
9.1 



0.0 
8.3 



0.0 
9.1 



Newly 
Married 



NA 



CO 
4.2 



8.3 

0.0 



Other 
Chan^f 



NA 

NA 



1.7 
4.2 



2.1 
0,0 



1977 Wee kday Colle ge 

Tl Traditional 99.2 0 S 

(n=133) 

Older 32.8 61.2 

(d=67) 

T2 Traditional 94.8 
(n=77} 

Older ^5.8 

(n^24) 

T3 Traditional 88.3 
(n=60) 

Older 35.3 
19_77 Weekend CoUe^e 



Tl Older 31.8 
(n=267j 

T2 Older 

(n--l29) 



32.6 



T3 Older 40.3 
(n=72) 



0.0 

33.3 



0.0 
41.2 



52.1 



39.5 



31.9 



0.0 
6.0 



0.0 
8.3 



0.0 

11. 'j 



16. 1 



18.6 



16. 7 



NA 
NA 



NA 



5.2 
4.2 



11.7 
11.8 



1.6 



l.A 



NA 
NA 



NA 



0.0 
8.3 



0.0 
0.0 



7.8 



Note. :;.A. — Not ,\ppllcabit> 
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Table 17. 



Coliege Fxperienco Variables for the Cross-Sectional Study 

Hajor 

Rt'si- Full Bell Fine Unde- 

lieiil Time Arts Sci Ed Sci N % Art cided 



1978 Weekday 
Gradual in)> SUideiits 



Traditioiia 



24.4 100. 4.4 0.0 13.3 0.0 62.2 20.0 0.0 



Older 
(n -~ IS) 



0.0 93.3 13.3 33.3 0.0 13.3 26.7 13.3 0.0 



19/7 Weekday 
Hnlering Students 



■ddit iuual 
(ii - bOl 



Jo. 7 



j.O ^),0 3.3 1.7 G3.3 18.3 3, 



Older 
(n - 17) 



11. H 47.1 0.0 17.7 ').9 0.0 SR. 8 S.9 11.8 
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Table 18. 



Residence Distributions across Occasions 
for the Longitudinal Study 



T2 Traditional 
(n=60) 
Older 

T3 Tradi t iona 1 
(n=48) 
Older 
(n-11) 



Res idence 



Commute 



Res ident 



1976 Weekda y College 

Tl Traditional 63.3 

(n^l20) 
Older 94.3 

(n=88) 



51.7 
87.5 



50.0 
81.8 



36.7 
5.7 



20.0 

0.0 



16.7 
0.^ 



Moved on 
Campus 



NA 
NA 



11.7 
4.2 



4.2 
1 



Moved off 
Campus 



NA 
NA 



16.7 
8.3 



29.2 
9.1 



1-^ W eekday Co liege 

Tl Traditional 
(n^!33) 
Older 
(n-67) 

T2 Traditional 
(n-77) 
Older 
(n-24) 



63.2 
92.^ 



53.2 
91.7 



36.8 
7.5 



35. 1 
4.2 



NA 
NA 



9.1 
0.0 



NA 
NA 



2.6 
4.2 



T3 Traditional 
(n=60) 
Older 
(n=17) 

197 7 Weekend CoJ^legt^ 

Tl Older 

(n=267) 

T2 Older 

(n^l29) 



48.3 
«8.2 



95. 1 



96.1 



23.3 
0.0 



4.9 



0.8 



NA 



5.0 
0.0 



2.3 



NA 



23.3 
11.8 



0.8 



T3 Older 

(n:-72) 



93.1 



0.0 



5.6 



1.4 



Note. N.A. — Not Applicable 
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Table 19. 



Student Status Distributions across Occasions 
for the Longitudinal Study 



Student Status 



Changed to Changed to 
Fu ll-ti me Part -time Part-time Full-time 



1976 Weekday College 

Tl Traditional 97.5 2.5 NA NA 

(n=120) 

Older 40.9 59.1 NA NA 

(n=88) 

12 Traditional 96.7 0.0 0.0 3 3 

(n=60) 

Older 50.0 20.8 0.0 29 2 

(n=24) 

T3 Traditional 95.8 0.0 0.0 I 

Older 36. A 18.2 0.0 AS 5 

(n=ll) 

Ti Traditional 97.7 2,'\ NA NA 

(n:^I33) 

Older 53.7 46. 3 NA NA 

(n-67) 

T2 Traditional 98.7 0.0 0.0 1 3 

(n-77) 

Older 50.0 8.3 0.0 Al.7 

(n=2A) 

T3 Traditional 91.7 0.0 8.3 0 0 

(n:^60) 

Older 41.2 5.9 5.9 47 1 

(n=17) 

^'^'^l Weekend College 

n Older 60.1 39.9 NA NA 

fn^268) 

Older 23.3 31.0 37.2 8 

(n=129) 

Older 8.3 27.8 6.9 5(, 9 

(.n=72) 



Note. N.A. — Not Applicable 
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Table 2n . 



ColU'XA' Mjjor nistrlbutlons ficross Occasions 
for tlie Lor.f'l Cudlnal Study 



Undoc ided 
Major 



Arcs/ 
Hum 



Behav, 
Se lence 



Commun . 



Educat ion 



1976 Weekday CoUeKc 

Tl Traditional 4.2 

(n=l20) 
Older 16.5 

(n=79) 



T2 



Traditional 

(n-60) 
Older 

(n=24) 



T3 



Traditional 

Older 
(n=ll) 



NA 
KA 



NA 



h.J 
11.4 



3.3 
8.3 



4.2 
9.1 



3.3 
13.9 



0.0 
12.5 



0.0 
0.0 



0.0 
0.0 



0.0 
0.0 



0.0 
0.0 



11.7 
12. 7 



8.3 
20.8 



8.3 
9.1 



197 ? Week day College 

Tl Traditional 3,9 7.8 7.0 0.8 4 7 

(n=128J 

Older 17.2 3.1 20.3 0.0 9.4 

(n-64) 

T2 Traditional NA 5.2 3.9 0.0 2.6 

(n=77) 

Older NA 0.0 , 12.5 0.0 4.2 

(n=24) 

T3 Traditional NA 5.0 3.3 0.0 3.3 

(n=60) 

Older N^ 0.0 17.6 0.0 .5.9 

(n=17) 

1977 Weekend College 

Tl Older 0.0 NA 47.8 22.0 NA 

(n=268) 

T2 Older NA NA 58.1 22.5 NA 

(n=129) 

T3 Older NA NA 66.7 6.9 NA 



.Note. N.A.--Not .ApolioibU? 
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Tiiblc 20 contlnuoiL 



Collei^e Major Distributions across Occasions 
for the Longitudinal Study 



1 9 /b Weekday Col]ege 
Tl Traditional 

(n=120) 
Older 

(ir-79) 



T2 



Trad it lonal 

(n = (>0) 
Older 



T3 



Traditional 
Older 



Sc lenco 



Nursing 



3.8 



b. 7 
0.0 



4.2 
0.0 



58.3 
3Q.2 



65.0 
33.3 



64.6 
54,5 



Fine Art 



8.3 

2.5 



8.3 

4.2 



Changed 



6.3 
9.1 



NA 
NA 



8.3 
20.8 



12.5 
18.2 



197 7 Weekday Cojjeje 

Tl Traditional 3.9 57.0 14.8 NA 

(n=l28j 

Older 45.3 1.6 NA 

ln:::64) 

T2 Traditional 2.6 59.7 14.3 11.7 

Older 4.2 58.3 4.2 16.7 

(n^24) 

T3 Traditional 0.0 61,7 16.7 10,0 

(n-bO : 

Older 0.0 58.8 5.9 11.8 

(n^l7 .1 

1977 Weekend College 

Tl Older NA 30.2 NA 0.0 

(n^268) 

T2 Older NA 19.4 NA 0.0 

(n-129) 

T3 Older NA 5.b NA 20.8 

in- 7^ ) 



NiUc. N.A. — Not AnpIl^.J^^' 
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Sampling and Data Co llectio n Prooec.ures 
Cros3-Sectional Study 



The first phase of data collection procedures for a 
cross-sectional sample began in a pilot study in May, 1977 (n - 
72). During their final weeks at Alverno, these students were 
mailed ^ a written rationale for the study requesting their 
participation in a letter from the Academic Dean. The response 
rate was 33 percent for this initial data collection. A fallow- 
up by faculty members indicated that the pressures of the 
pre-graduation weeks accounted for low participation. Since we 
were reluctant to alter our timing, for the next group, the 
December, 1977 graduating seniors (n = 32), we enlisted the help 
of department coordinators and divisional Chairpersons, who 
encouraged their major-^area students to participate. We also 
offered more flexible scheduling options within the final weeks 
of the term, but were still less than successful. 

As a result of these data collection experiences, we 
obtained as soon as possible, a list of May 1978, graduating 
seniors {n = 65) who were to participate in the cross-sectional 
study. The following procedures were used to enlist participants. 
Actual materials are contained in Appendix II and are lettered 
consecutively. We conferred with division Chairpersons and 
reinforced our request for aid in enlisting student participants 
at the faculty-wide institute in January, 1978. The professional 
disciplines (Nursing, Education and Management) all agreed to 
allow us class time. The Music Division, whose graduating 
seniors had no common classes, offered to forego the traditional 
day for completing college-wide assessments (Assessment Day: 
March 10), so that students could compl ete the measures. 
Chairpersons in the other divisions sent memos requesting 
participation to each of their students, and the Director of the 
Office of Research and Evaluation contacted then, for individual 
appointments in which the goals and rationale of the study were 
explained. Chairpersons were asked (Appendix A) to send a letter 
shortly before the event (Appendix B) . 

The Director of Research and Evaluation (also a principal 
investigator) spoke to each student detailing the rationale for 
the study. Individual talks were similar to the speech given at 
group sessions in each of the professional disciplines. The 
speeches that seemed to generate most student interest were those 
given to Nursing, Education and Management students in which wo 
tied student participation to the projected or concurrent studies 
of practicing professionals in Nursing, Education and Management. 
All groups were informed that NIE was funding the research, which 
seemed to generate interest in the study. These procedures for 
enlistment of participants proved to be effective. 

This 1978 graduating class contributed 400 hours towards the 
project during the 1978 spring semester. Instruments were spaced 
between mid-March and the beginning of May, except for t)ie 
written Interview for Graduating Seniors, which students wer.* 
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asked (and readily agreed) to take during final exam week to 
perserve the ''I'm graduating*' effect. vStudents were contacted by 
letter regarding their appointments for participation (Appendix 
C). Of the total, 250 hours were contributed in claosen or 
during a regularly scheduled college-wide assessment day. The 
other 150 hours were scheduled individually in the Office of 
Research and Evaluation. The high percentage of volunteers (only 
3 percent of those invited did not participate) and the high 
percentage who gave all the time requested (35 percent gave 6 
hours each; 15 percent after graduation) point to the success of 
the revised procedures. We thanked students for their 
contribution (Appendix D)< 



Long it udinal Study 

Kn trance Assessments 



For the longitudinal study begun in Fall, 1976 and 1977, the 
Muman Potential Measures were administered to all entering 
students in Weekday College during orientation days. Most 
instruments were administered to students entering Weekend 
College in Fall, 1977, during their first weekend of classes. 
They completed the remaining instruments Ln January, 1978. 

Kolb's Adaptive Style Inventory (AST), an important 
supplement to the Learning Style Inventory (LSI), was included in 
the battery of Human Potential Measures given to participants in 
the re-assessment of the Fall, 1976 sample, "Data on the two 
inventories were collected from the Fall, 1978, entering students 
in both Weekday and Weekend College. 

Prior to their involvement, students were introduced by the 
""Jirsctor of Research and Evaluation (one of two principal 
inves ciga to rs) to the purpose and rationale for the study. For 
students entering in Fall, 1976, a total of 236 initially 
participated in the longitudinal study using the Ifuman Potential 
N^asures. The following fall (1 977), a total of 2M Weekday 
"ollege and 274 Weekend College entering students participated in 
t^;e initial data collection phase and these student?? comprise th^^ 
second longitudinal sample, 

Faoh spring, following the first assessment of entering 
students in the longitudinal data collection for the 1976 and 
1977 entering cohorts, feedback s<-333ions were conducted by \:}ie 
Director of Research and Evaluation (Appendix E). At t>iese 
ir-essions, students in the longitudinal studies were given tlieir 
Lecirning Style Inventory profile and an interpretation of their 
individual scores, as well as group results. Appendix F, 
''Changes in Student Profiles on the Learning Style Inventory," 
(Mcntkowski, 19Bl) is a composite of the various materials that 
were successively distributed during the lorgitudinal study 
period. Any student unable to a t t^md (Mu* o f tlie f^^edtaack sessLorir, 
was mailed her profile and an in t^.^ r pre ta h i on (Appendix C). In 
addition, all 1 97B graduating se^niors in Du? c ross-S'?c t i ona 1 
study were mailed their feedback on the LSI (Appendix U) . 
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Second As sea s ine n t s 

1976 Weekday College: Sample 

During Fall, 1978, the first longitudinal sample (students 
who entered in Pall, 1 976) completed a midpoint retest on the 
Human Potential Measures. Our initial contact with these 
students took the form of a talk and a letter re-introducing them 
to the study and inviting them to further participate. The 
-Letter, i rom both the Director of Research and Evaluation and 
the division Chairperson of each student's major area (Appendix 
i;, identified the study as part of the Alverno experience and 
emphasized that they were contributing not only as students, but 
as future professionals. Of the 89 students in this group 84 
participated (94 percent). About "half the students completed 

the inventories during regular class meetings by 'arrangement with 
departments and instructors. The remaining studenW came to 
special group sessions or were scheduled individually,'^' 

The procedures for obtaining cooperation of the longitudinal 
participants were similar to those used to enlist graduating 
seniors in the Spring, 1978, semester. The project and the 
rationale for participating were explained in large group 
sessions where possible. The remaining students were sent 
letters from their division Chairpersons introducing the study 
(Appendix j). Then the Director met individually with these 
students to explain the nature of the study and the benefits from 
participating. Students were introduced to all the objectives of 
the MIE project, and were assured that they would be receiving 
feedback on two Learning Style Inventory Scores. 

The inventories were administered to students in large group 
sessions, during class time where possible. Students who did not 
have common classes were scheduled for large group sessions 
outside of class time. The remaining students were assessed 
individually through special appointments that were arranged at 
their convenience. Students received follow-up phone calls until 
the inventories were complete. Learning Style Inventory feedback 
packets were mailed to all participants (Appendix P). 



1979 Weekend College Graduates 

In Spring, 1979, we conducted a midpoint assessment for the 
26 Weekend College students who entered the nursing program for 
Registered Nurses in Fall, 1977. They were Individually 
contacted by the Director, by telephone and by letter (Appendix 
K). Of the 24 students, 20, or 8'j percent, part Loipated. They 
were also mailed feedback on the Learning Style Inventory 
Appendix F) . 



1 977 Weekday and Weekend 
College Sample 

In Fall, 1979, we conducted the major midpoint re test of tho 
second longitudinal sample (entered Fall, 1977). Letters of 
re-introduction to the study were sent to each student from her 
Chairperson in August (Appendix L, M), together with a written 
progress report prepared by the Director of Research and 
Evaluation titled "Understanding the Development of Thinking in 
College" (Mentkowski, 1981, Appendix N). A reminder letter 
followed at the start of the semester (Appendix O). Letters were 
also sent to the faculty, apprising them of the retest plans 
(Appendix P), ani informing them who would be absent from class. 
One hundred t- -nty-six Weekend College students and 101 Weekday: 
College stude^ o participated (91 percent . and 83 percent 
participation, respectively). Seventy-seven percent of the total 
Weekend College student sample completed the inventories durin^^ 
orientation weekend in August. The remaining students were 
contacted as part of an intensive follow-up procedure and 
completed the inventories individually at their ovrn convenience, 
sometime during the fall semester. Follow-up procedure included 
assistance from the Nursing Division Chairperson and the 
coordinators of the Management and Professional Communications 
Departments, all of whom agreed to send letters encouraging^ 
participation in the inventory collection (Appendix Q). 

Sixty-nine percent of the total Weekday College sample 
participated in the inventory collection on September 12 
(September 13 for some nursing students whose clinical schedule 
made this a more feasible date). Faculty showed their support of 
the study by excusing students from class on these dates to allow 
for their participation (Appendix R). Since many of the Weekday 
College students we followed up were in the Nursing Division, the 
Director met with the Chairperson of this division, and the Dean 
to decide on an appropriate follow-up procedure. The Director 
made a presentation to a group of nursing students who did not 
attend the inventory session, to elaborate on tlie purposes and 
importance of the study and to encourage their participation. 
These students were then sent a follow-up letter explaining that 
they could take the inventories at a time most convenient for 
them (Appendix S). They were asked to complete and return a form 
indicating their availability. 

Office of Research and Evaluation staff later met with tho 
Nursing Division Chairperson to discuss contacting students who 
did not respond. Taking into consideration the individual 
circumstances of students, varied follow-up approaches were used. 
Some were contacted by nursing advisors or instructors, others 
were called or writ':en to 'by Office of Research and Evaluation 
s taf f . 

Students who were in other divisions were contacted by their 
respective Chairpersons via mail, phone, or in person. In order 
to accommodate the students and allow them to choose a time most 
convenient for them (includin^^ evenings and w:?ekends) we arrar-^od 
a sc}^Mlule to meet the students* need:.') and administer Lh»» 
Inventor L^i;; to them, r 



P'rrorts of the divisions, departments, and individuals noted 
above resulted in a 28 percent increase in total participation in 
the Fall inventory collection ^4 percent increase for the 
Weekend College group and 14 percent for the Weekday College 
sample) . 

As with the first inventory collections, in the Spring 
following each midpoint assessment, feedback on the Learning 
Style Inventory was sent to students who participated in the 
rsecond phase of the two longitudinal studies (Appendix F) . For 
the entering Fall, 1976 group, the feedback packets included an 
explanation of the meaning of the individual profiles and some 
qualifications in interpreting one's own Learning Style Inventory 
profile. Graphs showing outcomes on the LSI for several groups 
at Alverno (Freshmen, Seniors, and students who did not return 
after their f ^ rst year) were also included, and these results 
were discussed. Some students contacted us with questions and 
commen . all of which indicated interest in the study. 

Feedback packets on the Learning Style Inventory prepared for 
tlie participants in the second longitudinal sample (Weekend and 
Weekday students entering Fall, 1977) consisted of individual 
profiles from 1977 and 1979, as well as group results (Appendix 
F). As previously mentioned, this feedback was combined with 
results from the 20 Weekend College students who graduated in 
Spring, 1979 (Appendix T). Comparisons with other Alverno groups 
were also included. 



Third Assessment 



1976 Weekday College Sample 

Inuring Spring, 1980, the first longitudinal sample (students 
who entered in Fall, 1976) completed a third and final assessment 
on the Human Potential Measures (n = 58). 

Diiring the first week prior To the start of classes (in 
August, 1979) each student received a letter from her 
Chairperson, inviting her to participate the following March and 
otating, once af^ain, the rationale for the study. 

This letter was mailed again to each student in a note from 
her Chairperson in January telling her when the administration of 
the Human Potential Measures (called inventories) would take 
place (Appendix IJ). The letter also reviewed the rationale for 
the study. In addition, the Director of Research and Evaluation, 
with some students who would be participating, generated a list 
3f questions students usually ask about the inventory 
collections. She then developed extensive written responses to 
those questions which further detailed the rationale and purposes 
of the Inventory: collections (Mentkowski, 1979) (Appendix V). 
This letter was mailed to all students, to/^^^ther with a note from 
her Chai rpt-rson (Appendix W) , shortly before the March i;5 
inventory adminln-tration session. In addition, the Director 
delivered a 20 minute talk to nursing students about the expected 
impact of their f)^ar ticipation, and the participation of the 
nurses who contributed to the nursing study, on tlie nursing/ 
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profession. The^so procedurer> resulted in an ifiitial 
participation rate of 6'3 percent. 

We ultimately achieved 96 percent participAition in tlie 
collection of the Huiaan Potential Measures in sprinf^ (_n = 58) 
through extensive follow-up. Sixty-eight students remained in 
the longitudinal sample in Spring, 19B0. Three additional 
persons from 1976 were still in school, but since they did not 
take the i nven tor ies in 1 978 for the midpoint assessiaent, they 
were not included in the follow-up, although we invited them (one 
did participate). Four persons were on 1- ive. Two persons were 
invited, but since they were being counseled out of the progr^am 
because they were not expected to meet graduation requirements at 
Alverno, we did not include them in the sample (one did 
participate) . 

The 96 percent participation rate was achieved through 
extensive follow-up of the students. Follow-up consisted of 
personal contact with ^^tudents by the student's Chairperson, 
instructor, or Office of Research and Rvaluat ion staff. This 
follow-up raised participation from 63 percent to 94 percent 
participating, with 79 percent completirg all 13 measures. After 
graduation, the Director continued the foilow-up (some :jtudpnt>^ 
indicated they could not participate until after school was 
over). Follow-up after graduation was 50 percent successful, and 
i t was more successful v:i th students whj had started so:ae 
participation prior to graduation. This post-graduation 
follow-up raised participation from 94 percent to 96 percent, 
with the percent of students completing all measuies increasing 
from 79 percent to 85 percent. 

In Fall, 1980, participants in the first longitudinal sample 
were sent their individual LSI profiles from 1976, 197B and 19-^^.- 
(Appendix F) . Graphs showing mean scores of various groups at 
Alverno were also included along with an explanatory letter. 



1977 Weekday and Weekend 
College Sample 

For the thin"* longitudinal assessment of students in the 1 9''7 
entrance cohort, an effort was made to enhance preparation for 
students to participate in Spring, 1 981 , and to reduce the need 
to follow-up nor -. esponders. In August, 1980, each Weekday 
College student received a letter from her Chairperson outlining 
the rationale for the study and inviting her participation tlie 
following spring (Appendix X). ^Phe letter to students with "Somi 
Questions and Answers About p]valuation Studies" was also mailed 
to each student.at that time (Appendix V). Faculty were apprised 
of the data collection at the August institute. During Fall, 
1980, Chairpersons met and selected a dat*^ in March 198' lor th^^ 
i nv e n t o ry administration. Fa c u 1 1 y wo r o 1 n f o r m f ^ 1 L n Do c em b e r o f 
the Mr.rch date, together with an extensive} ratumale and t\n^ 
"questions and answers" letter ( Mf^) tko wu k I , 1970) (Ap;r;ndlx Y); 
the date and rationale wore r<^'i f f i rmt?*! /it -Lanuary Faculty 

Institute. 



In early February, .students were af^prised of tml March daL--, 
toc,et:iev with th, ra t ional e ( Append ix ") . Facul ty we re mai l^-d 
information, on w!io would be ab.^ont from clas.s that day (Appendix 
■^^'l' '^-"^ time, the Director of Research and Evaluation 

made group or individual presen ta tion.3 to each person involv(-d 
providing the moot up-to-date ^^eneral results from tho 
:-3tudy— mostly from the professional studie.s and the foUow-up 
^yiidy -.f alumnae conducted the nrev^ous year. The paper prepared 
10 r thi.3 purpose, "Learning to Learn at Work," together with a 
letter from the Director (Mentkowski & Fowler, 1981, ApDendi^' 
.■ii3j, was given to students at the session with an elaborated 
question and answer letter (Appendix V). Participation for those 
expected to attend the March session was 96 percent, up from G'-; 
percent the previous year. Those who had already rescheduled, 
ii-i meet their appointjnents. 

Ot'virs were contacted, six {persons did not respond to 
toilow-up procedures; all were older women attending college 
p'lrt-ti.'ne. One younger person asked to be excused for health 
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Weekend students were involved a bit differently. They also 
received letters inviting their participation in a May 5, 1981 
ar.sesstnent m August, 1980, but were also invited +o attend'an 
August feedback^session (Appendix GC) at which the Director and 
Academic Dean (the other principal i..vys tigato r) met for an hour 
and provided feedbac. , mostly on the professional and alumnae 
studies. A letter from their Chairperson and the question and 
answer letter (Appendix V) were distributed (Appendix DO). The 
Director and Dean kept count of attendance, .md .srhu.lulrd 
more sessions during Fall, 1980 and one in January 1981 until, 
almost all had received feedback (Appendix RB) . Some individual 
feedback was given by phone or by the Director in a personal 
session. The Director wrote to students and called them if they 
iiad not indicated on a return form which session they nlanned to 
attend. ' * 

During April, 1981, the Dean and Director met with all but 
yne student in the 1977 entrance cohort for Weekend College, 
either in a class or individually. All students' schedules were 
e;c;imined to see where they could be met, either during or between 
classes; faculty were asked their permission to visit their 
class, or to ask to see a student in th'- hall between classes. 
The Dean and Director encouraged .student participation, orovided 
a rationale ^^and disseminated results orally and in written form 
i.a the paper "Learning to Learn at Work" (Mentkowski ^ Fowler, 
1 981 , Appendix BB) . 

Faculty were notified of ali procedures (Appendix FF) , and 
assessment^ times were scheduled during the regular assessment 
weekend with the assistance of the As.sessment Center (Appendix 
'). Follow-up, or rescheduling, occurred either before or after 
the scheduled session for those unable to attend. As a result of 
the follow-up, ultimately 93 percent of the V/eckday (_n -= 100) and 
fy percent of the Weekend College student;^ (n = 35) completed the 
friird phase of the study for this sn--'- 

In^ December, 1981, the results o individual L9 [ scorer, 

fcr 1977, 1979 and 1981 were so.- to the second longitudinal 
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3:^aple group (Appeml ix P) . ThL?^ rj'oup '\l3o seat ^^rMphr. o 

tholr group^^' mean LS [ -jcorei-: and a h:'tte?r of explanation oT t^io 



A:imini3tratlon of the TnventoriejB 

For the most part, admiaist ra tion of ail Human Potential 
Measures occurred on a single day. As a student arrived, she was 
f.^iven a form for collecting information on a^,e, major, etc, , and 
a list of names and corresponding code numbers. Each student 
used her code number on all the instruments, plus the date. Code 
lists and the information sheet were returned. If a student 
arrived early she began the untimed instruments. 

Following a welcome and restatement of the purpose and 
rationale for the session, all students beg.an by oompletin,": t/ie 
timed instruments. The Director of Research and l^^valuation paced 
the students through those, and then, following instructions for 
completing each instrument, the students were directed to 
complete the untimed instruments in a paticular order. The timed 
instruments were completed in one hour and fifteen minutes. 
Students were then directed to take a break (refreshments were 
provided), and to then work at their own pace, being careful not 
to let themselves become too fatigued, and to take a break v/hen 
they needed one. As each inventory was completed, the student 
brouglit it to the front of the room, took another, and so on. 
Students usually completed the inventories in 4 to '3 hours; th(^ 
session began at 3:00 a.m. and continued until '3:00 p.m. i^ne 
inventories wore completed in the following order: 

Test of Thematic Analysis 
Picture otory Exercise 
Analysis of Argument 
Defining Issues Test 

Meas'-ve of Educational, Vocational and 

Personal Issues 
Learning Style Inventory 
Moral Judgment Instrument 
Adaptive Style Inventory 
Life liistory Exercise 
Test of Cognitive Development 
Watson Claser Critical Thinking Appraisal 
Attitude Survey 

Careering Questionnaire (third assessmc only) 

Students who were in the interview subgroup were asked to 
c-'mplete the Moral Judgment Instrument after they completed the 
Learning Style Inventory. 

Students who, for a variety of reasons, completed the 
inventories at a time scheduled at their 'onvenience, wore given 
the same instructions and asked to compiete the i nunc n t.". in 
the ::ame onier. Students were, howev-r, asked to time thcMnselvc:; 
on the timed inventories. 
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During the lunch hour and after students completed the 
Inventories in the midpoint assessment, the Director met with 
them individually and in small .'groups to hear their comments and 
to give them general outcomes of the work. \t the final 
assessment, she met with students who had not been in class or 
individual feedback sessions, in order to see that all students 
had similar information and personal contact. 



Data Anal ysis Plan an d 
Metho ds of _Analysis 

The data analysis plan was organized around three basic 
questions. First, did the selected instruments record change 
across the three occasions of assessment? oecond, to what extent 
might change be due to the Alverno learning process rather than 
to age-related maturation or d if fe ren^, in background and 
variations in type of college experience? Finally, what, if any, 
patterns of change -merge in the interrelationships of the human 
potential measures and other measured variables? 

The purposes of this report do not include in-depth analysis 
of any particular instrument in isolation from t.he others. While 
it was necessary to conduct parallel analyses of individual 
measures to take full advantage of complete longitudinal data, we 
were primarily concerned with the overall patterns of results 
across instriimen ts. One important aspect of this orientation is 
that we have not concerned ourselves with individual reliability 
analyses and adjustments as we would if our inferences an'd 
conclusions were based on only one or two instruments. 

It should also be noted that the data analysis plan was 
created and implemented with the emphasis on desc ription and 
exploration of relationships in the data that might"" i'ndicate 
value-added" by r.he learning process. In this spirit, we have 
in many cases highlighted relationships between variables at the 
_£ < .10 level as well as at liigher levels of statistical 
signi ficance. 



')esc ribing Change Over Occasions 



Change over occasions of assessment was investigated in two 
ways:^ (1) change as a function of time and (2) change between 
occasions of assessment. The former emphasizes the developnental 
nature of the investigation and the latter emphasizes its 
quasi-experimental char^^cter as a study of outcomes at the 
mid- point and end of the college experience. The first 
question. Did change occur?, was answered in both ways for all 
instruments. Multiple linear regression techniques were employed 
to describe change as a function of time.. Analysis of 

variance techniques for repeated measurer' were used to evaluate 
differences between first and second as3er;smen ts , and between 
second and third assessments. 



In tho un'ily^i^ of me^mures an a function of time, the <lat-i 
from each instrument wore examined for both linear an.i non-line^ar 
relationships with time. Values of O (at entrance), 2 (for two 
years aft^.^r en tranche), and (for three and one half years 

after entrance) were established for tiie three assessinen I: 
occasions. Quadratic time (time Sfiuared) was included in all 
subsequent analyses of the time function only when its 
contribution to variance explained (over linear time) was. 
statistically si,-^nif leant at the .05 level. In the evaluation of 
chan^^e between occasions of assessment, possible backf^round and 
program covariates were initially i.^nored to simply describe trie 
overall pattern of observed differences acrosr; neasures whicr. 
were statistically si^^nificant at .10 or hi.i:her levels. 



A Causal Analysis of Change 
fo r Bo th I n ter vills ' 

The second question, concernin^,^ t>u.^ value added by student 
experience ia the learnin^i process over age-related maturation 
and other background and prograrn differences was investi,^ated 
usin^;^ a combination of siinu? taneous and hierarchical set-wise 
r<3gression procedures. A common procedure was followed in 
independent analyses of each measured outcome for both intervals 
of assessment. Our approach to the analysis of chan^ie between 
occasions of assessment was basically a hierarchial method of 
variance p i rti tioning. Assessments definin;^ each interval were 
treated in effect as pre-post assessments on each measure. 
Post-scores were regressed on pre-scores and the residual, or 
regressed change, was then analyzed in relation to student and 
pror;*am characteristics and performance variables indicative of 
student experience in the learning process. The five steps of 
this procedure were as follows: 



Step 1 

Data from the three entrance cohortij were pooled 
ail d the pooled d -i t a for each i n s t r iim e n t we r e 
examined for correlation with age and other 
background variabl?a in individual regression 
analyses. Since all background data wore 
catego rical, mul tiple regression witli dummy 
variables was used to determine the mul ti /.e 
correlation of categories defining each variable 
with scores derived from each instrument. 



Step 2 

The categorical background variables found to 
correlate significantly < .05) with t}ie 

dependent measure were then subraitted to 
hierarchical set-wise regression in a 

pre-determined order. The imposO(! order was a weak 
causal ordering based on presumed temporal sequence 
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of influence. From one perspfjc ti.ve, this step 
previa ei3 at lenr.t a p'irtial historical oxplanation 
of ob;icrvei v?.^riatioa in developmental an^l ability 
levels a!: rjntrance to college. From anotlier 
perspective, it r^i/^nals particular i.istance.s of 
statiotical relationship between the outcorae 
mea:--;ure3 and individual or sub/_^roup clia r ac L e r i s l ics , 
pre-existinf; potential effects of college that must 
be controlled to answer the "value-added*' question. 
At thi.' step, possible interaction effects among 
niultipl- back^:: roun-.I predictors were ignored, since 
[aost, if not all, of the variance accounted for by 
tlie background variables is absorbed by pre-pcores 
as predictors of post-scores in the next step. 

Step 3 

Next, post-scores were regressed on pre-scores for 
both intervals, i.e., scores from the second 
assesisinent were regressed on scores from trie first, 
or enti^ance, assessment, and third assessment 
scores were similarly regressed on second 
assessment scores. As with the time function, 
non-linear as well as linear relationships were 
tested. Non-linear elements were included in 
further tests when their unique contribution to 
post-score variance explained was statistically 
significant at the .05 level. Background 
correlates of entrance scorer- were then tested for 
unique contribution to post-s^'ores with pre-scores 
held constant. Background variables accounting for 
posb-score variance with pre-scores controlled were 
then retained as covariates in investigating 
regressed change in relation to variations in type 
of college experience. 

Step 4 

College experience variables presumably irrelevant 
to the oompecence based learning process included 
entrance cohort, resident or commuter status, 
full-time or part-time status, and major field. 
Post-test scores were regressed on each college 
expe rience variable, with pre- test sco res and 
background covariates held constant. In cases 
where more than one college experience variable 
contributed significantly to variance in 
post-scores under these conditions, entrance cohort 
was first accepted and other variables were then 
entered in all possible hierarch-::cal combinations. 
The combination achieving the highest cumulative 
increment in variance explainer, determined which 
college experience variable would be retained as 
CO var iate. 

SV 
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:\ e p vo c c y\ in ^ r>te w-:^ c o u: .> '] t o build a nn i i u ^ 
e (!['•, 1 H t L (!) n f o r e a ( ; } i s c o n d a n d third as < ^ 3 r^m e n t s c o r e 
o f e a c r. 1 ri t rum e n t th a t -i c o u ri t od f o r th 0 ra x imuTi 
' uri 0 u n t o f vnrinnc'^ a .- 1 f u n t i. ^) ii of p e - 1 e g t 
iicores, 'A^'^e and other back^-^ rournl variabler^, and 
program variables, in : 1 order- Witr. 

0 0 V L a t ^. . 3 e t d t> 1; e r'^n i a 0 d r^:) r e a c h m ea s n r i^; , t h r e 
pe r f orniriace var Labi 3 inn ica t.in.p; s I ud en t expe rience 
i:\ tlHi Ir^arnLn^^ proc^.s:3 wore (.Mit-»red to Inve^jtigato 
the " val i,ie-a(i d ed " quers t ion. The th ret) jv;- rf o rTiiano^; 
var L abl. os we re a) r.uiabe r f r>on es t-? ra a 1 1 'Mid ed , b ^ 
nanber of credit hour unit:^ ao ou:n ulateii , and c) 
number of competence level units icciunulated - 

■Jonclusions concerning; the value-r 1 by the 
competence-based learning procesis .^re linked 
pa r c ieu] -i r ly to the number of coripeteace level 
units ac ciunulated and the relative contribution of 
thi.s variable vis-a-vis the oth.er two- 



Relationships A:non^ }luman Potential Measures 

To investigate pa 1 1 e rn s of i u t l' r rel a t i 0 nsh i ps 'i m o nr^ ti 1 *^ 
h urn an do t e n t i a 1 measures, several f a c to r a n a ly s e s we r e pe r fo rm ed 
on all measures together, and then on a subset of measures which 
permitted comparisons of factors across oc carrions of assessment- 
No t all measu^'s could be included because of incomplete dat.i, 
espec^^lly for entrance assessiaen ts - Some indices had to be 
oxclud>:;d cc'jaase of mathematical dependenci-'S, while others were 
e X c 1 u d ed ' i e c a us> e l' m 1 e s t i 0 n s emerging in Dm d a t a a n a ly sis a b 0 u t- 
wh a t t e m e a s. a r e . 

An al y s e s of entrance asses sm e n t s we r e given the g re a t e s t 
'•■eight in, efforts to interpret factors, since re testing had an 
unkn 0 vrn • 1 n d c e r ta i n ly variable effect on d i f f e r e n i; i n s t r luii (^n t s - 
Our basic approach v/as to accept factors extracted from first 
a S3 e ,'3 sp f^' n . s as establishing t?i e grounds for interpretation o f 
unilerlying dimensions, and chen ^.o ^'onsider differences in 
factors extracted from second and third assessments in relation 
to entrance fac tors as poss ible ef fee ts of t[ie learning 
expe r ienco . 

'^hile principal componencs were e^'^racted routinely to 
establish reference points for to . 1 riance vs. common 
variance, niimber of factors to exi '^tc, the intc^rpreted 

factors were inferred through a f tctor^ / y\ (Alph.a factor, 

Nie et al- , 1975) which est li. at:*.^s common variance from the 
m.^ltiple correlations of eac]: variable^ witn all o'.her variables, 
and produces fa^^'ors t';--. '-ve maximum gene ralizab ility across 
measures- Obliq'.-.^ rolat: chws-.^ both to permit extraction 

of hi -'he r- 0 r d er f a c to r s , . r- ■ . t*; t a c 1 1 i t a t e in t e r pre t a t i o n of 
fac tors - 
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inuiee.-> or :neasiiro3 not included in the common factor 
'inalysec. -^ere still utilized in interpreting^ factors throu^'h 
examination of their correlations with the extracted factors. 

In this phase of tho analysis, the emphasis is more on theor/ 
construction than theoi-y validation, and consequently, the 
statistical si^^ni f icance of relationships v;as not af^'- r'r tlie 
kind of attention and use as a criterion of judgment ao tlie 
causal analysis. In the presentation of factor matrices, higher 
loadIm^s /ire underscored, but all loadin^^s yj.'.; presonV-d \and 
taken into account in the interpretation of . i v tor. 

Based on the framework developed throu^^h the series of factor 
analyses and correlations of factors and measures, relationships 
vver^-^ sought betwe-n dimensions of development and chan.^^e 
iHiderlyin^.' the hmnan potential measures. 
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T>ie measure:} of hiiman potential were provisionally considered 
to divide into two subsets. Five of the selected ir.struments 
were constructed to as.sess dimensions or levels of development 
from primarily cognitive-developmental perspectives. The 
rernainin^^ seven inst nuinen ts were constructed to assess a variety 
of cterac teristics and abilities related to developnent and 
learnin/5, but not from explicitly co^^ni t ive-developnen ta !. 
y ::\poc t i, V'.^'■■. . 

Vor the immediate purpose of reportin/-^ and comparin^.^ re:3uli;s 
froin individual instruments, a tenative hypothesis was developed 
concern : n,': i;uj .elative influence of co^;^ni tive-developmental 
factors among the second set of instruments. The hypothesis was 
that, among those instruments not desi^^ned explicitly op 
cognitive-developp.ental grounds, the measures derived from the 
Picture Story Exercise would be most affected by developmental 
factors. We expected the Learnin/;^ Style Inventory and Adaptive 
Style Inventory to show loss relationship to developmental 
factors than the dispositional indices of the Picture 3tory 
Exercise, but more of a relationship to tlieso factors than to tlie 
narrower measures of analytic ability. 

Our initial hypothesis was that the order of influence of 
developmental factors would show up both in the 
interrelat ionsiiips of measures and in the separate relationships 
with student and program variables. In tlae latter case 
specifically, we hypothesized that the more developmental 
measures would sliow stronger associations with variables 
representing greater life experience, such as age, and parent's 
education and occupation. Less dev -lopmental measures would show 
stronger assuciations with indices of academic experience, and be 
more affected by college program differences, such as residence 
and major. 

Tlie order of presentation, and table formats including all 
instruments, reflect in part our initial hypotheses. The 
distinction between production and recognition tasks in 
instrument design was also taken into account as a subsidiary 
1 ac tor in organ idling the presentation of resul ts , as were 
conceptual and quantitative similarities and differences. ^11 of 
these features of inst rumen ts were considered to facil itate 
comparisons among the results of independent analyses performed 
on each measure. Further divisions and catef^orizations of 
individuals, measures, and occasions used as guidelines in data 
analysis and organization of presentation are noted and discussed 
as hey appear in the text. 

The first )urpo3e of using the external criterion measures of 
human potential was to describe differences and change in st)ident 
development . The cross-sec tional data describe d if ferences 
between comparable groups of entering students and graduating 
students assessed in the 1977-78 academic year. The longitudinal 
data describe changes in development of students entering Alverno 
in the Fall of 1976 and in the Fall of 1977. For each of the 
three entrance cohorts included, assessments wore admiaisteied at 
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en.rance, two yeaz-B after entrance, and threo and one-half year'i 
a. ter entrance. As anyone familiar with the usual wide ran. e and 
variability of development and abilities of college stiident.s 
mit'ht expect, the re.3ults from multiple ;near,urement.-/on multiple 
occasions produce a complex picture of difference and chan^^P. 
.here are no concise af^grefiate results, and no simple 
conclusions. 

^ General descriptions of the group data are presented below in 
.wo parts. First, the cross-sectional data are illustrated in 
_>.ae form of raw score frequency distributions. Frequencies havp 
oeen reduced to percentages of students responding at the givpn 
Level, and are shown on the vertical axes. Wie horizontal 'ax.-^ 
are marked '^Ith the metric particular to the ^-iven i nstr.Jiaen-' 
t-ollowmg the cross-sectional data descriptions, the longitudinal 
data are presented in the form of estimated raw scores as a 
function of time of assessment apd dichotomous classifications of 
age and cumulative educational achievement. Summaries of the 
quantitative data illustrated in the graphs, and related tests of 
^ta.is.ical 3ign;:icance presented in the text, can be found in 
appendix T. 



Cross-Sec tional Results 



Figu-,3 2 through 14 show, for each instrument, the 
distributions of scores for entering and graduating student? in 
the cross-sectional study. Most plainly evident across the 
spectrum of measures is the large overlap in distribution. This 
underscores the obvious: students do not enter college a^ a 
unifomly lower level of development or ability, nor do they 
graduate at a uniformly higher level. 



c:i>i;nit. i ve.-l)evf 1 .ininenLal Measures 

The distribution of ratings on the three essays comprising 
the Measure of Vocational, Educational, and Personal Issues arp 
shown in Figure 2. We have referred to this measure throughout 
as the MVEPI; recently the name has been changed to the Measure 
of Intellectual Development (Mines, 1982; Moore, 1982). While 
all chree essays show identical ranges for entering and 
graduating students, there appears to be a shift in central 
tendency from transition between dualistic and multiplistir 
thinking to a stable multiplistic perspective. Only the "Career" 
essay shows a noticeable percentage of graduating students in 
transition towards more relativistic thinking. (Based on our 
extensive work with this instruiaent at Alverno, we have strong 
doubts about its sensitivity to higher positions of Perry's 
scheme.) 

Summaries of analysis variance tests of this and following 
cross-sectional comparisons are presented in Appendix I, Table D.' 
Main effects of group were statistically significant on the 
^Decision" and "Career" essay ratings, but not on the "Best 
Class" ratings. 
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Figure 3 pr^-^ents the distributions of Total Protocol Ratings 
ivon the Was}rLn{'; ton University Sentence Compl^^^tion Test of Ego 
Development. Thi.s fi>-^ure shows tlie mean level of enterin/^^ 
students to be the transition between r:onformist and 
"onscientlous st'-ifv-.; of f^^^^o Development, while the majority of 
graduatin^l students were rated at the Consc ien 1 1 ;us level or' at 
the transition between Conscientious and Autonomous levels. 

The difference between groups was statistically si.c^nificant 
on the Ego Development measure, Even though age was not 'found to 
significantly correlate with the pooled entr'ance cohorts of the 
longitudinal study, it was enterefi as a covariate in the analysis 
of variance of cross-sectional groups. The finding of ao 
correlation was confirmed for this group comparison, 

^s previously reported, two instruments based on Kohlberg's 
Moral Development theory were utilized. Figure 4 presents the 
distributions of Moral Maturity Scores derived from Kohlberg's 
produc t ion- type instruiaent, and Figure 5 presents tlie two indices 
caiculatet: from Rest's Defining Issues Test (a recogni tion- type 
measure ol Moral Developaen t) . The reported indices both 
instruments are co.itinuous scale scores rather than position or 
stage scores. Please note that the data from Kohlberg's Moral 
Uudi^aent Instrument in Figure 4 are from a small subsample of the 
c r-oss-sect lonal groups. Though most students from both groups 
f'all into ;:he Moral Matur„^ ty Score range indicative of 
Conventional thinking, there are noticeably fewer graduating 
students in the Pre-Converitional range and more in the 
Post-Conventional range. v^i le the simple mean difference was 
significrrnt, when age is controlled, the main effect of group was 
not sign! f leant. 

Of the five instruments initially conceived and selected as 
me/isures of cogni t ive-developaen tal outcomes, only the Defining 
Issues Test results show a general shift in distribution between 
entering -and graduating groups. The better known ?% score 
distribution — the percentage of responses indicative of 
principled thinking--fo r the graduating students broadens and the 
entire ran^^e shifts higher on the scale. The D ocore, calculated 
from all responses, shows the same general shift up the scale, 
but does not flatten out like the P^ index. For both indices, 
age was a significant covariate. lUit, unlike the Moral Maturity 
Score, there remained a significant main pffect for group with 
age controlled. 

There appears to be little difference in distributions on the 
Piagetian Test of Cognitive Development shoWii in Figure 6. There 
was no statistically significant difference between groups on 
this measure, but there was significant covariance with high 
school gravie average. 

Briefly summarizing the cross-sectional results on the five 
cognitive-developemen tal measures, significant main effects of 
group were fouiid c;j three instruments: the Measure of Vocational, 
Educational, and Personal Issues; the Sentence Completion Test of 
Ego Development; and the Defining Issues Test, ' For tliese 
comparison group data, the measure of Perry's developnental 
scheme and the Ego Development measure were not related to age. 
Both measures of Moral Development were related to age, and with 
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'ill fi^ I .! uJ , liuM'c '.^re no dkii;^, otl"<^!:s ol ,.;r»>r,p on Kohlhory/s 
Mot\i[ iudK,::ienL JnsLrunicnL. Biu t.iiuro wrTo i .^n i ! i o.iP.l main 
of foots for group oai both indicos dorivod I roiii i-osi's Doi iinri- 
fssuos !oHL, Scores on Llio Tost of Ci^i'.aiL Lvo )ovolopnienL wore 
corrolated noL with a.;o, huL wLl!i liL^h school .made [nuut 
avorao,o, tiiul main ot toe's tor :.:r',Hip ua-r^' n-^L slaLisioallv 
s 1 ^;n i r i can I . ^ ■ 

It is beyond the scope of this report to present inory 
detailed analysis and discussion of outcomes on individual 
instruments. As stated at the ■be^-inninr: of this section, our 
focus is on the ^enor.^l or overall weight of evidence provided by 
both cross-sec tlon^i-^nd lon^^ Ltudinal data. 



( c n (J r i c Ah i. J 1 1. y Nl ;i s u r o s 

Figures 7 tarough 9 show distribTLions of scores der-^vod Trom 
the Picture otory Exercise. The p.^a.sure of Stages of Adaptation 
13 based on a psychosexnl d evel opnic.t model, and ^he 
3elf-Definition score and Motive scores are not overtly 
aevelopmental in character. For the purposes' of depictinr tho 
distributions, the horizontal axes are marked off according ho 
the simple range of the respective scoring systems. Percentages 
are in terms of average scores across the six .vtories writtea\y 
each student. Statistical analyses of measures taken from the 
Picture Story Exercise were conduclod on total -v^oi-es corrootod 
f^or story length and standardized to a moan of ^0 and a atan<iarj 
deviation of 10; The latter scores appear in tlie sumiaaries of 
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analysis of variance in Appendix I, Table D. To facilitate 
comparison iicross cross-sectional and lon^^itudinal data, word 
length corrections and standardization of reriiduals were computed 
on pooled data. 

^3 can be observed in Figure 7, there appears to be little 
difference in the average score distribution of entering and 
graduating groups on the four Stages of Adaptation. S lal. 1 st Lea 1 
tests for group differences (on corrected and standardized total 
scores) resulted in significant main effects for group only on 
t}ie Integrative score. Contrary to our expectations, the enter- 
iag .^^oup avera:.;e was hi.v;iujr tiiaa that ol' i'.raduatln^ students. 

Figure 8 shows the d is,tributions of scores on the measure of 
Self-De fini tion for entering and graduating students. Although 
the graphic of the raw score distributions makes it appear that 
there were group differences, the analysis of variance test gave 
only a non-significant indication of group differences < .10). 
The distributions of motive scores in Figure 9 show average 
differences^ on the Achievement Motive score and the Power Motive 
score, but not the Affiliation Motive score. The graduating 
group appears lower on the Achievement Motive and higher on the 
Power Motive. In the statistical analysis, the former difference 
between groups was significant and the latter nearly so (_£ < 
.10). (statistical analysis of uncorrected total scores, by the 
way, showed nd outstanding contradiction of these results.) 

The cross-sectional results from Kolb's Learning Style 
Inventory are presented in Figures 10 and 11. It was mentioned 
in the section describing the measures that tViere was a 
"built-in" correlation between the Concrete Experience score and 
the Abstract Cone eptual ir.at ion score, and between the Eeflective 
Observation slio re and the Active Experimentation score (since to 
some extent, preference for one of the pair precludes a 
preference for the other in the way the instrument is designed). 
First, looking at the subscores in Figure 10, the graduating 
gr.^up shows less preference for Concrete Experience and for 
Reflective Observation, and a greater preference for Abstract 
Conceptualization and Active Experimentation. The largest 
discrepancies are in preferences for Reflective Observation and 
Abstract Conceptualization. Indeed, group differences on these 
two subscales were highly significant, wliile group differences on 
the Concrete Experience score and the Active Experimentation 
score were not significant. 

Figure 11 shows the distributions of composite scores, the 
Abstract/Concrete Learning orientation and the Active/Reflective 
Learning orientation. Again, these composite scores are derived 
by substracting the second subscale score from the first. There 
is a clear difference in the preference of graduating students 
for Abstract Conceptualization over Concrete Experience, and 
Active Experimentation over Reflective Observation. Both group 
differences were statistically significant. Kolb's Adaptive 
Style Inventory was not administered to the graduating group, so 
a cross-sectional comparison was not possible on this measure. 

Three ex te rnal criterion measures wore used wh 1 ch re flee t 
different aspects of generic critical thinking abilities: the 
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Test of Thematic An.ilysis, .Analysis of Argument, and the 
Critical Thinking Appraisal. The cross-sectional distributions 
for these measures are presented in Figures 12 throu/;^h 14. For 
the Test of Thematic Analysis, shown in Figure 12, there was 
little observable difference in distributions. The test of main 
effects of group. was not significant. Attack and Defense scores 
from the Analysis of Argument are shown in Figure 13. The 
difference between groups was significant for the Defense score, 
but not the Attack score. The graduating students were 
apparently better able to switch perspectives and defend a 
position they had just attacked. The three subscores of the 
Critical Thinking Appraisal are presented in Figure 14. Although 
it appears that graduating students performed better on the 
Induction tasks, this difference was erased when high school 
grade was introduced as a covariate. . Likewise, differences on 
Deduction task were significantly correlated with high school 
grades, and ti^re was no significant main effect for group. 

The last of the external criterion measures introduced 
earl^ier, the Life. History Exercise, was not administered to the 
•group of graduating students. 



Cross-Sectional Suiimary 

^ - ■ 

Summarizing the cross-sectional results, the graduating group 
had a significantly higher average on three of the five 
cognitive-developmental measures. With the exception of an 
unexpected higher average Integrative score for entering 
students, there were no significant differences between groups on 
Stages of Adaptation derived from the Picture Stnr-- K>;c- ^ 
Nearly significant differences were found on Jefiuiti^ii 
sc^-^ ^ ^3 an ' M^^ ■ .jcores, with the graduating .^roup showing 

owe :ie--i.. ucore on Self-Definition and a higher mean score on 
the Pow. Motive. The graduating group scored- significantly 
lower on the Achievement Motive, and there was no difference in 
Affiliation Motive scores. The graduating group showed a 
significantly greater preference for Abstract Conceptualization 
and a significantly lower preference for Reflective Observation 
on the Learning Style Inventory. The only significant group 
difference on the critical thinking measures was a higher Defense 
score for graduating students on the Analysis of Argument. 

Table 21 presents this summary of significant differences 
between groups for the cross-sectional study. To' thft left of the 
list of measures ar^e shown the two test characteristics discussed 
earlier. (This table format will be repeated in the longitudinal 
results section to facilitate oro33-reference. ) To the right oi 
the measures is the column indicating v;l' i/aer the graduating 
group was significantly higher lower than the entering group. 
A blank indicates no difference; a question mark appears where 
the probability value was greater than .05 but less than .10. 
Grey areas indicate that the measure was not administered to one 
or both groups. 

With respect to the distinction noted between production and 
recognition tests, while there is no clear difference simply in 



,g 101 



40 



40- 



30- 



r\ 



30-: 



C 

0) 

U 20 
4) 

a 



10 



/ 



0 



A- 

-3 -1 0. 1.^ 2 3 
total score 



4 5 
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cross-sectional comparison of entering and 
graduating students. 
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Tables 21. 



Measure of 
Vocational, 
Educational, 
and Personal 
Issues 



Stcnlf leant Differences Between Groups For 



tjic Cross-sectional Study 
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Stageo of Adaptation 
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Integrative 
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terras of significant re-^sults, the quan*titative data anaylsis 
summary presented in Table D in Appendix. T does show a cle^ir 
difference in the order of magnitude of differences recorded by 
production versus recof^nition tests. The F ratios obtained on' 
recognition tests were distinctly higher than on production 
tests. ¥ith respect to the working hypothesis concerning the 
developmental character of the measures, the pattern of results 
shown in Table 21 seems to support the contrast of the 
cognitive-developmental measures and less developnental measures. 

vSpecif ically , age was found to be a significant covariate 
only on the measures of moral development while high school grade 
was a Lignificant covariate of two subtests of the Critical 
Thinking Appraisal. The Test of Cognitive Development was also 
related to academic achievement however, which contradicted our 
expectation of the instrument as a developmental measure. The 
relationship signals tlie possibility that the kinds of problems 
chosen to measure formal operations are too sensitive to academic 
experiences. The results give multiple indications of 
cognitive-developmental differences between groups and multiple 
indications of no difference in generic critical thinking 
ability. 



Longitudinal Results: Change Over Occasions 
Change as a Function of Time 

We now turn to the longitudinal data for answers to the basic 
question: did the instruments record difference and change?- 
Figures 15 through 50 present, for each instrument, graphic 
representation of outcomes as a function. of time of assessment, 
and also display differences for four subpopulations defined by 
age cohort and cumulative achievement in the competence based 
assessment process. A straight line sloping up from left to 
right indicates a positive linear correlation between outcorae and 
time of assessment. The hoi'izontal axis represents time; the 
vertical axis represents the particular metric of each measure. 
The unequal intervals between assessments accurately represent 
the unequal time between assessments, i.e., the second assessment 
was "two years after entrance and the third assessment was one and 
one-half years after the second. 

The four lines give additional information on the relative 
level of performance of subgroups defined by membership in two 
dichotomous categories. Age cf'fehort divides the population into 
traditional and older age groups. Trad'*. ^ional age students were 
17-19 years old at entrance; older students were 20-55 years of 
age at entrance. The second dichotomy pertains , 'to educational 
achievement in the competence based learning environment, indexed 
by number of Competence level units accumulated during the course 
of study. These units are analogous to credit hours, but are 

•earned by demonstration* of levels of competences defined in the 
Alverno curriculum. This four-way breakdown, while ignoring the 
varilible influence of other background and program information, 
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provides a comparison of the relative importance of age and 
achievement across all measures. Summary data for these analyses 
are provided in Table E of Appendix I. 

The figures illustrating change over time display regression 
lines computed independently for each subsample created by the 
four-way' breakdovm. This allovfs the slope of each line to depict 
the rate of change for each subgroup separately. The statistical 
analysis summarized in Table E and presented in the text were 
conducted on pooled data. A result indicating significant chanie 
over "time mekns there was significant overall .change, though the 
figure may make it appear that one or more subgroups change^ mote,e 
than others. 



Cognitive Develop mental Measur es 

Fig|Ure 15 shows the three essay ratings of the Measure of 
Vocational, Educational, and Personal Issues. The two lines 
representing membership in the older age group are above those 
representing the traditional age group, and they are closer to 
each. 'Other than the pair is to the lower pair of traditional age 
subgroiKps. This shows that, on average, age was a more important 
factor 'in ratings on this cognitive-developmental measure than 
was achievement, and that older students received higher ratings. 

For the "Best Class" essay, the upward slope of the lines 
from first to third assessment indicates aa average improvement 
in ratings over time. For the "Best Class" essay,- both the 
relationship between overall outcomes and time, and the mean 
difference between older and traditional age students, were 
statistically significant. Differences in cumulative achievement 
level were no t " ^igni ficant. As measured by this essay, the 
population as a whole showed developnent in perspective on 
classroom learning over the study peri.>d. Older students showed 
a generally higher level of develojjient than traditional age 
students. In^ terras of Perry's (1970) scheme, the older 

student enters college with a multiplistic perspective while the 
traditional age student still exhibits some duallstic thinking. ^ 
On the "Decision" essay, a slightly different . picture 
Gm«;>ges. The slope for "traditonal age students . shows a 
curvilinear relationship between outcomes and time of assessment. 
The ratings increased slightly from first to second assessment, 
but then decreased from second to third assossiaent. As with the 
"Best Class" essay, the relationship between outcome and time of 
assessment was statistically significant. In this case, however, 
both age and achievement level make a statistically significant 
difference in mean ley el of rated development. Older students 
nve rated higher than traditional age students with achievement 
controlled, and higher achieving students ar-.' rated higher than 
lower achieving stud .'nts with age controllnd. This pattern in 
difficult to inte-rpret from the numbers alone, sinao tho i:or\t<mt 
of the' "Decision" essay in not coruttrainml by tho. inMU-urnnnt. 
inntructiops. Qualitative nnnly^u^ of tho protocols wi 1 1 bo 
necessary to determino tho refortMits of thoMo Mpparont^sh i ft;! i,n 
porsjpoctivo. 
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For the "Career" essay, the small positive correlation 
between outcomes and time of assessment was not statistically 
significant. There was a clear and significant mean difference 
in the ratings given to older students versus traditional age 
students, while there was just as clearly no difference between 
groups classed by cu^nulative achievement. The older students 
began wi'/h and maintain a more multiplistic perspective on career 
issues ao measured by this instrument. 

ResultK, from the Washington University Sentence Completion 
Test of Ego Development, presented in Figure 16, show very little 
overall differentiation related to the variables of this 
analysis. Neither the correlation between outcomes and time of 
assessment for the three entrance cohorts combined, nor the mean 
difference related to the two dichotomous variables of age cohort 
and achievement were significant. The overall population mean 
falls between the Conf ormist/Consc ientious transition and the 
Conscien-tious stage of Ego Development. 

Figures 17 and 18 present the longitudinal data from the two 
measures based upon Kohlberg's Moral Development theory. For the 
Moral Maturity Score from Kohlberg's Moral Judgment Instrument, 
there '.%'as no rela-^.ionship between outcomes and time of assessment 
for the small sample assessed. Mean differences between older 
and traditional age cohorts were significant, witn older students 
scoring higher on the index (i.e., exhibiting more 
Post-Conventional thinking). Means of subgroups divided on 
achievement were not statistically significant. In contrast, 
both and D indices from Rest's Defining Issues Test were 

linearly related to time of assessment. The'Principlod Thinking 
index (P^) indicated a somewhat greater rate of change over time. 
Mean differences between age cohorts were significant for both 
indices. The achievement dichotomy also accounts for significant 
mean differences in the case Of the Principled Thinking index, 
but not on Da^^ison's D score. Common sense could suggest that 
improvement in recognition of more principled value positions in 
some areas might ocqur before, or without, change occurring 
"across the board." 

The Test of Cognitive Development results are shown in Figure 
19. The overall improvement in scores across assessments was 
statistically significant, but mean differences for age and 
achievement cohorts wore not. 

The longitudinal results on the fiv^ c ^^nitive-developmental 
measures generally support and exten ?^ findings from the 

cross-sectional results. Statistically significant improvements 
in outcome over time were found on th- Measure of Vocational, 
Educational, and Personal Issues, the Defining Issues Test, and 
the Test of Cognitive Development. There were significant mean 
differences between high and low achievement subgroups on tho 
"Decision" essay of the Measure of Vocational, Educational and 
Personal Issues, and on the Principled Thinkinf^ Index of the 
Defining Issues Teat. Mean differences between traditional and 
older a^'ie cohorts wort? found on all hut tho Ego Dovelo raori t 
measure and the Piago t ian-based Test of Co^^nitlve Devolopment. 
In all cases except the Test of CognitLvo Development, the age 
cohort dichotomy was observed to bo a more Important variable 
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Figure 17. Moral Judgment Instrument scores as a function of time for 
students grouped by age cohort (traditional or older) and 
by college performance (high or low). 



1 



87 

112 



60 • 



o!df'.-^:Ov/ 



: troc'&hich 

» ^ « 

30 • • ^ oldr&hiqh 

1 2 3 4 5 . ^ .... 

first second third 



40 



3b 



25 




first 



;.ecund 



Tiird 



lynre .18 Del Lnin^^ Issues Test scores as a function of time for students Rroi 
by a^e cohort (trad itional or older) and 1)V college perl ormance (h: 
or low) 



8H 



15 



4 



U -1 



J! 15 

o 

o 



12 -i 



10 



irod&low 
trad&high 

Ml., ^tf >> «1 

ojdr&hlgh 



first 



second 

05S0S smenf 



third' 



Figure 19, Test of Cognitive Development encores a function of time tor 
students grouped by age cohort (traditional or older) and by 
college performance (high or low). 



than the educational achievement dichotomy. Simple comparisons 
of cr033-3ec tional and longitudinal results on each instrument 
are confounded by the higher proportion of older students in the 
longitudinal data base. 



Generic Ability Me asures 

Figures 20 through 22 present longitudinal data derived from 
the Picture Story Exercise. Results from the Stages of 
Adaptation scheme are shown in Figure 20. 

The overall relationsnip of outcome and time of assessment 
was statistically significant for Receptive and Integrative 
indices. Scores on both indices indicate an overall decline 
across the three assessments. The decline of a passive- receptive 
orientation was, in the context of this study, a positive and 
expected finding. The decline in the Integrative index, which 
matches the cross-sectional result, was unexpected. The 
cumulative achievement dichotomy produced no significant mean 
differences on the four indices of Stages of Adaptation. The age 
cohort difference was significant for the Receptive and 
Autonomous stage scores, but not the Assertive and Integrative 
scores. 

The Self-Definition index shown in Figure 21 was not 
significantly related to fcime of assessment. There was a 
significant mean difference between age cohorts, with traditional 
age students scoring higher on the Self-Dd finition scale. 
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Figure 20. Picture Story Exercise/Stages of Adaptation scores as a function nf time 
o for students grouped by age cohort (traditional or older) and by college 

ER|C performance (high or low) . 
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Picture Story Exercise/Self -Def inition scores as a functioa of time 
for students grouped by age cohort (traditional or older) and by 
college performance (high or low). 



This also matches the cross-sectional data when entering 
' students scored higher than graduating students. None of the 
motive measures, shown in Figure 22, were significantly related 
to time of assessment, nor were mean differences between the 
dichotjmized subgroups significant. As was the case with the 
graphic description of cross-sectional results, the figures 
showing longitudinal results from the Picture Story Exercise 
describe outcomes in terms of an- average score across six 
stories, while statistical analyses were computed, on total scores 
corrected for story length and standardized. 

' The Learning Scyle Inventory results in Figures 23 and 24 
provide, the only case in which the educational achievement 
dichotomy produced significant mean differences and the age 
cohort grouping did not. The structurally correlated Concrete 
Experience and Abstract Conceptualization subscales, presented in 
Figure 25, and their composite representation as 
Abstract/Concrete Learning orientation, presented in Figure 24, 
show the high cumulative achievement group had a significantly 
lower preference for Concrete Experience and a significantly 
greater preference for Abstract Cone eptualizat ion. The 
complimentary scalesf' on preferences for Reflective Observation 
and Active Experimentation did not reveal significant mean 
differences based on either grouping, though in simple raw score 
terms, age appears to make more of a difference than achievement. 
All scales from the Learning Style Inventory were significantly 
related to time of assessmenr., "except for the Active 
Experimentation subscale shown in Figure 25. Consistent with the 

9, 11^' 



ERIC 



c 

0) 1 



.1 



O 0.5 



first 



second 



third 



trad&low 
oldr^dow^ 
trad&high 
oldr&hjgh 



1.5 



> 



.9 

o 

0.5 



first 



Q) 
> 

E 
I. 

Q) 
? 
O 



r 



0.5 



first 



r" 

3 

second 



third 



3 

second 



third 



Figure 22 Picture Story Exercise /Motive scores as a function of time for 
students grouped by age cohort (traditional or 'older) and by 
college performance (high or low). 
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I'i^uri.' 23. Learning Style inventory scores as a function of time for students 
grouped by age cohort (traditional or older) and by college 
performance (hi^h or low). 
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Figure 24. Learning Style Inventory/Composite scores as a function time 
for- students grouped by age cohort (traditional or older) and by 
college perf orinance (high or low) , 
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cross-sectional results, the dramatic changes over. time seem to 
occur in increasing preference for Abstract Conceptualization 
over Concrete Experience, and a decreasing preference for 
Reflective Observation in relation to Active Experimentation. 

The Adaptive Style Inventory was only available for 
administration to all three entrance cohorts for second and. third 
assessments. The results show no significant overall change. On 
this measure, which was in part designed to overcome the 
structural limitations of the Learning Style Inventory, the total 
Concrete Experience scale score gives • evidence of age cohort 
differences not fo'ond on the Learning Style Inventory, and this 
age cohort difference remains in the composite Abstrac t/Concrete,t 
Adaptation orientation. The small differences airong other 
subgroups on Reflective Obsei: \'at ion. Abstract Conceptualisation,, 
and Active Experimentation presented in Figure^ 25 were not 
statistically significant, nor were they significant on the 
Active/Reflect composite score shown in Figure 26. 

Figures 24 through- 26 present longitud inal data from the 
three measures of generic critical thinking abilities. For the 
Test of Thematic Analyses, in Figure 27, there was no overall 
change across the three assessments, but older studen^ts as a 
group performed signi f icantly better than trad itional ' ' age 
students. The difference between high and low achievement groups 
was not significant. 

There was no relationship with time of asq^ssment on either 
Attack or Defense scores from the Analysis of '^^''rgum'ent, neither 
were there mean differences related to age cohort or cumulative 
achievement. Analysis of Argument results, are shown in Figure 
28. 

All three subscores of the Critical Thinking Appraisal, in 
Figure 29, were found to be significantly related to time of 
assessment. Older students obtained higher scores on Inference 
and Recognition subtests, but there were no ^ age differences on 
the Deduction subtest. The educational achievement dichotomy did 
not produce significant mean differences on any of the three 
subtests. 

Life History exercise results were available for all cohorts 
in the second interval only. There were no significant 
differences found in relation to time of assessment of either age 
or educational cohorts. 
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Figure 25. Adaptive Style Inventory scores as a function of time for students 

grouptd by age coKort (traditional or older,) and by college performance 
(high or low). 
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Figure 26. Adaptive Style Inventory /Composite scores as a function of time 
for students grouped by age -cohort (traditional or older) and 
.S, by college performance (high or low). 
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Figure 27, Test of Thematic Analysis scores as a function of time for studen 
grouped by age cohort (traditional or older) and by college 
performance (high or low). 
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Figure 28. Analysis of Argument scores as a function of time for students 
grouped by age cohort (traditional or older) and by college 
performance (high or low) . 
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Fifiure 29. Critical Thinking Appraisal scores as a function of time for 
students grouped by age cohort (traditional or older) and by 
collage performance (high or -low), 
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Life History Exercise scores as a function of time for 
students grouped by age cohort (traditional or older) and 
by college performance (high or low). 
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Summary of Change as a 
Tunctio n of Time 

The foregoing analyses of aggregate student development over 
time provided several indications of change, and ample evidence 
of differences between the two categorizations of subpopulationa. 
In those cases where significant mean differences were found 
between subgroups, it was clear that age cohort made more 
difference thaa cumulative achievement in the competence based 
learning process* The single exception was the Abstract/Concrete 
learning orientation of the Learning Style Inventory — a result 
not replicated on the closely related Adaptive Style Inventory. 
There were a few instances in which both age and education 
categories accounted for significant differences in average 
performance, and instances in which neither accounted for 
differences. Given that there were only three occasions of 
assessment, the interpretation of the curved lines as growth or 
learning curves is very tenuous indeed. More reasonable is the 
suggestion that something different occurs during each of the two 
intervals (i.e., either there was change in one interval but not 
the other, or there was change in both intervals, but in opposite 
d irec tions) . 



Change Between Assessments 

The longitudinal data were subjected to single- factor 
repeated measures analysis of variance separately for the two 
assessment intervals. Tables 22 and 25 present the results of 
these analyses for all students combined, and independent 
analyses for subgroups defined by age cohort and educational 
achievement. For ease of comparison, the row format for measures 
is the same for both tables, and identical to the fo^^mat of Table 
21 showing cross-sectional results. The grey areas indicate the 
absence of data rather than non-significant results, and an 
appended question mark after * increase' or 'decreases-reflects a 
statistical probability level between .10 and .05. Summary data 
for repeated measures analyses of variance for each interval are 
presented in Tables F through R of Appendix I. 

The separate analyses for each time interval offer a 
different perspective on change than that afforded -^.^y the 
preceding analyses of performance over all three assesanent 
occasions. The most general impression gained is the greater 
overall incidence of change in the first interval compared to the 
second . 

Prom the perspective of these analyses, it is evident that 
change occurred in opposi-te directions during each interval on 
some measures — most notably the motivation indices from the 
Picture Story Exercise. ' The results for all students combined 
show a significant decrease in the Affiliation Motive from first 
to second assessment, and a significant increase from second to 
third assessment; and an opposite pattern for Power Motive 
scores, with an increase during the first interval followed by a 
decrease during the second interval. There was no significant 




Table 22. 



Significant Differences between First and Second Assesijments 
for All Students, and for Students Grouped by 
Age and Educational Achlevensent Cohorts 



Meosure 



3 

O 



Measure of 
Vocational, 
Educational, 
and Personal 
Issues 

Sentence 
Completion 
Test 

Moral Judgment 
Instrument 

Bef ining 

T b'sues 
Test 

Test of 
Co gnit Ive 
Development 

Picture 
Story 
Exercise 



Learning 
Style 
Inventory 



Adaptive 
Style 
Inventory 



Test of 
Thematic 
Analysis 

Analysis 
of 

Argument 

Critical 
Thinking 
Appraisal 

Life 
History 
Exercise 



"Best Class" Essay 
"Decision" Essay 
"Career" Essay 



All 
Students 



Traditional | Older 



Increase 



Age Cohort 



Competence Level Unltr 



Increase 



PZ Score 
D Score 



Stages of Adaptation 
Recept ive 
Autonomous 
Assertive 
Integrative 

Self-Definition 

Achievement Motive 
Affiliation Motive 
Power Motive 

Concrete Experience 
Reflective Observation 
Abstract Conceptualization 
Active Experimentation 

Abstract /Concrete 
Learning Orientation 

Active/Ref lect ive 
Learning Orientotton 

Total Concrete Experience 
Total Reflective Observation 
Total Abstract Conceptualization 
Total Active Experimentation 

Abstract /Concrete 
Adaptive Orientation 



Increase 
Increase 

Increase 

Decrease 

Increase 
Decrease? 

Increase 



Decrease 
Increase 



Increase Increase 
Increase Increase 

Increase 



Increase 



Increase 



Inc rease 



Decrease 
Increase 



Decrease 
Decrease Decrease 
Increase Increase 
Decrease Increase? 

Increase 



Dec reaae? 

Increase Increase 
Increase Increase 

Increase 



Dec rease? 

Increase? Increase? 
Decrease 

Increase Increase 



Decrease? Decrease 
Increase Inctease 



Decrease 
Decrease 
Increase 



Increase Increase 



Active/Reflective 
Adaptive Orientation 



Attack 

Defense 

Inference 

Recognition 

Deduction 

Performance 

Improvement 




Decrease 
Decrease 
Increase 



Increose 



ERIC 



1Q3 



123 



Table 23. 



Stgnlflcanl Differences Between Second and Third Assesstnents 
for All Students, and for Students Grouped by 
Age and Educational Achievement Cohorts 
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change in Achievement. Motive scores from entrance to second 
assessment, but a significant increase between second and third 
assessments. Similar fluctuations were found for the Assertive 
Stage score from the Picture Story Exercise measure of Stages of 
Adaption. There was an overall increase in Assertive Stage 
scores between first and second assessment, and a significant 
decrease during the second interval. 

In Tables 22 and 23, we see that there were only two cases of 
statistically significant improvement across both intervals for 
all students combined: the Principled Thinking Percent {'?%) 
score from the Defining Issues Test and the Deduction score from 
the Critical Thinking Appraisal. Only the ''Decision" essay from 
the MVEPI shows significant reverse change over the two intervals 
corre.'jponding to the curvilinear relation holding between overall 
performance and time. For all other cases in which the overall 
relationship between performance and time was significant, the 
repeated measures analyses for each interval indicate overall 
change during one interval, but not both. A different picture is 
gained for the two essays from the Measure of Vocational, 
Educational, and Personal Issues that were significantly related 
to time of assessment. For the "Best Class" essay, the slope of 
the lines in Figure 15 indicated a gradual overall improvement in 
ratings across the three assessments. The repeated measures 
results confirm an overall improvement in ratings between second 
and third assessments, but not between .first and second 
assessments. The independent repeated measures analyses of 
sub-populations suggests a partial explanation; between first and 
second assessments, the ratings ol the older student cohort 
increased significantly while those of the traditional age cohort 
did not. The reverse was found for the second interval. For 

the "Decision" essay, the repeated measures analysis of all 
students comb,ined shows the same increase followed by decrease 
depicted in Figure 15. ^ ^ » 

The overall relationship between the "D" score from the • 
Defining Issues Test and time, and between the Test of Cognitive 
Development and time, shown in Figures 1 6 and 17, respectively, 
appear in the repeated measures analyses to be primarily due to 
increases between first and second assessments. The findings .of 
no overall change acfoss time for the Moral Judgment Instrument 
and the Sentence Complet'ion Test of Ego Development, were 
coT'roborated by the repeated measures analyses, though there was 
a nearly significant increase in Moral Maturity scores- between 
second and third assessments. 

Changes in Learning Style preferences were found to occur 
between entrance and second assessments, but not between second 
and third assessments. The Critical Thinking Appraisal Inference 
score improvement occurred during the first interval, while the 
Recognition score improvement occurred during the second 
interval. There were no significant overall changes for either 
interval on the Analysis of Argument or the Test of Thematic 
Analysis. The Adaptive Style Inventory and the Life History 
Exercise were administered to all students in the longitudinal 
sample only on second and third occassions of assessment; there 
were no significant main effects of occasion on either measure. 
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Comparison of Cro sn-sec tional 
a nd Lo ng i t ud i n a_l ^f^^ 1 ts^ 

Considering^ both forms of analysis of the pooled longitudinal 
data, and the analyses of subgroups defined by age cohort and 
educational achievement > we can make some comparisons between . 
longitudinal and cross-sectional results for 

cross-substantiation. Tn comparing cross-sectional and 

longitudinal result.s, it should be kept in mind that the 
cross-sectional da .a compared entering and graduating students 
principally, though not exclusi \ s::ly , of traditional age, whereas 
tne pooled longitudinal data include the Weekend College cohort 
composed entirely of women in the older age cohort. 

Table 24 lists those indices which record differences between 
entering and graduating students in the cross-sectional study, 
and change during at least one interval for students in the 
longitudinal study. 

The strongest cross-substantiation was, not surprisingly, on 
two instruments more alike in form than presumed function (i.e., 
sharing the characteristic of requiring simple recognition): the 
Defining Issues Test and the Learning Style Inventory. Among the 
recognition- type instruments, these two probably require the 
least effort from the respondent. While on the one hand, the 
characteristics of simplicity e.nd ease connote a mOre superficial 
measurement, from the standpoint of those who argue for- 
"edumetric vs. -psychometric'* characteristics, theso instruments 
may be seen in a more positive light. Irrespective of these 
issues, there is little doubt that the greatest degree of 
generality of effects can be claimed for the changes these 
instruments measure: increasing choice of more principled 
reasoning in the evaluation of moral dilemmas, and increasing 
choice .of Abstract Conceptualization and Active Experimentation 
over Concrete Experience and Reflective Observation as preferred 
components of a Learning Style. 

Longitudinal Resu lts: A^_?A4£5A 

Analysis of C hange 

The second major purpose of assessment and data analysis was 
to examine the extent to which change over the three occasions 
was due to involvement in the Alverno learning process versus 
individual differences in age and other background 
characteristics, and variations in program. While the 
longitudinal data are defined by a time structure rather than a 
student classification structure (e.g., assessing students as 
entering Freshmen, first-semester Juniors, and "graduating 
Seniors), the time structure was meant to correspond with the 
intervals of the general education sequence and the 
pre- professional sequence experienced by the typical student. 
For this reason, as well as the .evident differences in magni-^tude 
and direc tion of change for each assessment interval , the 
analysis of factors contributing to change was conducted on each 
interval separately. In the following section, separate results 
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Table 2A. 



Comparison of Group Differences in the Cross-sectional Study 
and Change Between Assessments in the Lon>^i tudinal Study 



Significant Main Effects of 
Group Cross-sectional Study 

"Decision" Essay (MVEPI) 
"Career" Essay (MVEPI) 

Total Protocol Rating (SCT) 

P % Score (DIT) 
D Score (DIT) 



Integrative Stage of Adaptation. (PSE) 

Self-Definition? (PSE) 

Achievement Motive (PSE) 

Power Motive? (PSE) 

Abstract/Concrete Learning (LSI) 
Active/Reflective Learning (LSI) 



Significant Main Effects of 
Occasion Longitudina l Study 

"Best Class" ^.ssay (MVEPI) 
"Decision" Essay (MVhPI) 



P % Score (DIT) 
D Score (DIT) 

Total Score (TCD) 

Receptive Stage of Adaptation (PSE) 
Assertive .Stage of Adaptation (PSE) 
Integrative Stage of Adaptation (PSE) 

Self-Definition (PSE) 

Achievement Motive (PSE) 
Affiliation Motive (PSE) 
Power Motiv< ^PSE) 

Abstract/Conr te . 
Active/Ref lec L . ve > . aing ; 

Total Score? (TTA) 



Defense Score (AA) 

Inference Score (CTA) 
Recognition Score (CTA) 
Deduction Score (CTA) 
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are thus reported for the interval between entrance and second 
assessment, and the interval between second and tlilrd assesoiaent. 

Before examinin/; factors contributing to change between 
intervals of assessment, we must look at the individual 
differences related to variance in the first, or entrance, 
assessments . 



Relationships Between Student Characteristics 
and Entrance Measures 

The first step of the causal analysis was to, determine 
relationships be-^ween entrance assessments and personal and 
background characteristics of students. Table 23 presents the 
significant relationships between first assessments and the 
available data on student characteristios. The complete matrix 
of correlations is presented in Appendix I, Table S. Paired 
comparison t tests among all levels of each correlated variable 
are presented in Appendix 1, Tabic T. In Table 25, the order of 
the input variables from left to right represents the order of 
entry employed .in hierarchical regressions to eliminate redundant 
contributions to variance explained by the. substantial 
intercorrelations of personal and background characteristics. 
Variables in parentheses show^-d significant zero-order 
correlatior^3 with the respective measures, but did not explain 
significant- variance in that measure over and above variance 
explained by correlated variables of higher precedence (variables 
to the left in the table) . 

For example, the entra-nce ratings on the "Decision" essay of 
the Measure of Vocational, Educational, and Personal Issues were 
correlated with age, religion, father's occupation, and marital 
status. However, the relationships between essay ratings and 
both religion and father's occupation were redundant with that 
between essay ratings and age. Since age was assigned higher 
precedence for the causal analysis, the covariance between 
ratings and all three input variables (age, religion, father's 
occupation) was allocated to age. The semi-partial correlations 
of ratings with religion and father's occupation were not 
statistically significant. Marital status, on the other hand, 
explained a significant amount of variance in essay ratings in 
addition to the variance explained by age. kge and marital 
status together, in this instance, explain as much ^^of the 
difference in individual entrance ratings on the "Decision" essay 
as can be explained by the entire set of personal and background 
characteristics when entered in the given order. 

It is clear that more of the measures were correlated with 
age than with any other input varla^ble. Given the relative 
homogeneity of the Alverno 3tudent\opulation with respect to 
background characteristics, and its relative heterogeneity in 
age, especially with the inclusion of the 1977 Weekend College 
cohort, it is not surprising that many relationships between 
background differences and entrance mear.urements were, largely 
explained by age differences. The most notable exception was 
marital status. On "Decision" and "Career" essays of the Measure 
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TflbU 25. 



Rolationships Between Ertrance Aesessiner.tB and 
Student Backgr -und Variables 
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Measure 



Measure of 
Vocational » 
Educational, 
and Personal 
Issues 

Sentence 
Completion 
Test 

Moral Judgment 
Instrument 

Defining 
Issues 
Test 

Test of 
Cognitive / 
Developoerit 

Picture 
Story / 
Exercise / 



Learning 
Style j 
Inventpry 



Adaptive 
Style 
Inventory 



Test of 
Thematic 
Analysis 

Analysis 
of 

Argtunent 

Critical 
Thinking 
Appraisal 

Life 
History 
Exarciae 



2: 



"Beat Class" Essay 
"Decision" Essay 
"Career" Essay 



Av,e + (Rel) 
Ate + 



Age + 



(FOc) 



MSt 

(PCE) MSt 



?X Score 
D Score 



Stages of Adaptation 
Receptive 
Autonomous 
Assertive 
Integrative 

Self-Definition 

Achievement Motive 
Affiliation Wctlve 
Power Motive 

Concrete Experience 
Reflective Observation 
Abstract Conceptu^lzation 
Active Experimentation 

Abstract /Concrete ' 
Learning Orientation 

Active/Reflective 
Learning Orientation 



Total Concrete Experience 
Total Reflective Observation 
Total Abstract Conceptualization 
Total Active Experimentation Age + 

Abstract /Concrete 
Adapti' ? Orientation 



GPA 



Age - Rel 

Age - (Rel)(MEd) 



(rCF) 

(PCE) (MSt) 



/ 

Age + 

Age- (Rel) 



Age (Rel) 



(FEd) 



MSt 



Active/Reflective 
Adaptive Orimitation 



Attack 

Defense 

Inference 

Recognition 

Deduction 

Performance 

Improvement 



Age + 



Age + 



Age + 



FEd 



MSt 



(PCE) MSt 



(MSt) 



GPA 

GPA 
GPA 

. GPA 
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of Vocational, Eciucational, • and F^ersonal Issues , the 
Ac tivo/Re flee tivo component of the Adaptive Style Inventory, '\nr\ 
the Test of Thematic Analysis, there were si^^nificant differences 
due to marital status with age controlled. Although it is 
outside the scope of this report to partjue the matter here, it is 
interesting to note that in each of the cited cases, it was the 
relatively siiia] 1 proportion of divorced or widovred women whose 
higher ratings or scores accounted Xov this addd:tional variance 
component (see Table U, Appendix l). 

A second noteworthy pattern in Table 25 is. seen' in the 
associations of measures with age versus high school grade level. 
The entrance assessment variance in the more developmental 
measures is in more cases related to age, whi le the generic 
ability measures are in more cases related to high school grade 
level.' While this cannot . be taken as a validation of the 
distinction between developmental and ability measures in any 
simple sense, it raisr.s a questioii about the apparent 
contradictions found,, in the correlation of Test of Gogniti^'^e 
Development entrance scores with high school grade level, and the 
x>crrelation of the" Test of Thematic Analysis and Analysis of 
Argument Defense scores tith age. - - 

Equally interesting are- those instances of no correlation 
between measures and input variables. Except for judgments that 
might be made rt-lative to the' reliability and validity of 
measures, established in other research settings, there is little 
evidence, at this step of the present analysis on which to base an 
interpre'ta tion. 

► -/ 
Covariates of Change Between Assessments 

The descriptions of the longitudinal data presented earlier' 
provided general evidence of charnge^in the population as a whole, 
ignoring the differential affects of background characteristics 

'and variance due to type of college e*xperience. Once these 
3o6irce3 of covarlance are identified, we can ask if differential' 
involvement in the learning process contributes to development, 
while holding constant causally antecedent and coincident sources 
of variance. Tables 26 and 27 summarize the results of a series 
of analyses dasigned to identify b^^^^round and prograia 
covariates in each interval. 

In Table 26, the first column gives the percentage of 
N variance in second assessment measures that can be explained by 
students' scores or ratings on entrance measures, two years 
earlier. The simple correlations between first aftd second 
assessments on each measure are presented in Appendix 'I, Table V. 
Where "XXX" appears i-n the f i rst column of Table 26, the 
correlation between first and ' second assessments was judged 
non-significant and therefore the analysis of covariance was not 

.carried out. The lack of linear relationship between occasions 
of assessment, ' like the lack of correlation between entrance 
measures and student characteristics, can be -a sign oi* 
unreliability of 'measurement, though it is not necessarily .so. 
The significant correlations between occasions of first and 
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Table 26. 



Stjdent Background and College Program Variables Related 
to Cnange Between First and Second Assessments 



Measure 



"Best Class" Essay 
"Dpi' If. Ion" r.f's.iy 
"(.'.ire or" K.^s.iv 



Score 
I; Score 



Measure of 
Vocat ional , 
Educational » and 
Personal Issues 

Sentence 
CompleC Ion 
Test 

Moral Judgment 
Instrument 

Def Inlng 
Issues 
Test 

Test of 
CoRn 1 t Ivf 
Dev<>lopment 

Picture StaRtJs of Adaptation 

Story Receptive 
Exercise Aiitonotnour. 

Asse rt I vt? 
Integrative 

Self-Definition 

Achievement Motive 
Affiliation Motive 
Power Motive 

Learning Conci'eLe Experience 

Style Reflective Observation 

Inventory Abstract Conceptual Uat ion 

Active Experiroentat ion 

Abstract/Concrete 
Learning Oi icntat ion 

Act 1 ve/Re f lec nlve 
Learning Orientation 

Adaptive Total Concrete Experience ^ 

Stvlo Total Reflective Observation 

[nvontnry Total Abstract Conceptualization^ 

Total Active EKperimentatiuii 

Ahst ract /Cone ret e 
Adaptive Qrlt^ntatlon 

Act Ive/Re f lec t ivc 
Adaptive Orientation 



lt}Kt of 




Til emu t Ic 




Ana lys Is 




Anal yn Is 


Attack 


of Argument 


Defense 


Critical 


Inf erencr* 


Ih Inking 


RecoKnlllon 


Appral nnl 


Deduct ton 


iMv Hlatory 


Pi-r h^rriwinc*' 


Ex«M r l !»«• 


Improvement 
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' 'MncludftH Hlgnlf leant quadratic element. 

''inrludett HlKnlflcant Interaction between PCE and ECo. 
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Table 27. 



Student Background and ColloKC Program Variables Rcl.-ited 
to Change Between Second and Third Afjsessmoncs 



Measure 



Measure c 
>Vocat lonal , 
Fducaclanal, and 
Personal lasues 

Sentence 
CompLet Ion 
Test 

Moral Judgment 
Inst rument 



"Be6t Class" Essay 
"Decision" Essay 
"Career'' Essay 



Defining 
I Issues 
Test 

Test of 
Cogn 1 t Ive 
Developraent 

P icture 
Story 
Kxerc isc 



Learning 
Style 
1 nventory 



Adapt ive 
Style 
Inventory 



Test of 
Themat ic 
Ana lysiu 

Analysis 
of Argument 

Crlt leal 
Thinking 
Appra i Ha I 

l Uo HUtory 



Pt Score 
D Score 



Stflges of Adaptation 
Rocept ive 
Autonontoua 
Assertive 
Integrat ive 

Self-Def initlon 

Achievement Motive 
Affiliation Motive 
Power Motive 

Concrete Experience 
Reflective Observation 
-.Abstract Conceptualization 
Active Experimentation 

Abst ract /Concrete 
Learning Orientation 

Act ive/Ref lect ive 
Learning Orientation 

Total Concrete Experience 
Total Reflective Observation 
Total Abstract Conceptualisation 
Total Active Experimentation 

Abflt ract/Concrete 
Adaptive Orientation 

Act ive/Ref 1 ect ive 
Adoptive Orientation 



At.taL k 
!)t*f enae 

Irif er enre 
Rerognit ion 
f)e<luct ion 

Improvemt^nt 



3. I 

2^.2 

12.2 
-31.6 



XXX 

1.2 
16.0 



XXX 

IS. 3 
2 7.4 

30.0 

13. A 



31'. 7 
31.0''^ 

ia.9 
2s.;'' 

20,3 



XXX 

xxy 
/ ^> , 3 

17..' 



Background 
Covariat^s 



Prop.ara 
Covartates 



u u 



ECo 
ECo 



ECo 



5.8 
2.^ 



32. A 



Res 



MSt ^'.7 



ECo 



Kes 



3. 5 



2.2 



2.6 
3. 3 
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second assessment ranged from a low of .148 for the Autonomous 
Stage of Adaption and the Achievement Motive (both from McBer's 
Picture Story Exerc ise) , to a high of .649 for the I) score of the 
Defining Issues Test. Conversely, and more meaningful for 
present purposes, the variance in second assessments left 
unexplained by entrance measurements ranged from 97. 8^ for the 
former indices, to 58. ,7^ for the latter index. Significant 
polynomial terms are included in the percentage figures in the 
first column as indicated in the table footnote. 



Background Covar iates 

All student characteristics identified previously in Table 25 
as contributiijg to - variance in entrance scores in the 
hierarchical regression analysis were tested for contribution \o 
second assessments over and above variance explained by entrance 
aseosments on the given measure. Summaries of these tests are 
presented in Appendix I, Tables W and X. Those characteristics 
explaining significant amounts of variance in second assessments 
beyond variance explained by the respective entrance assessments 
are listed in the second column of Table 26. The percentage of 
additional variance explained is shown in the third column. 

Prior college experience accounted for differences in second 
assessment ratings on the "Best Class" essay of the Measure of 
Vocational, Educational, and Personal Issue . that were not 
related to entrance ratings. Students who had prior college 
experience received higher ratings on perspective classroom 
learning. The test for interaction between prior college 
experience and first assessment ratings was not significant 
however, indicating no differential rate of change in ratings 
during the two year interval. 

Age had a differential affect on change for three of the 
measures: the "Decision" essay from the measure of Vocational, 
Educational, and Personal Issues; the D score from the Defining 
Issues Test, and the Abstract Conceptualization- scale (and 
Abstract/Concrete cjmpo.iite score) from the Learning Style 
Inventory. The affects were not the same for all three measures 
however. For both cognitive-developmental measures, older 
vstudenta exhibited more change than younger students in the first 
two years. Bvit- younger students showod a greater irh rease in 
preference for Abstrac*. Conceptualization as an element of 
Learning vStyle. 

Prior academic performance, as measured by high school grade 
level, differentially affected scores on two measures, but again 
not in the same way. On the Test of Cognitive Development, 
students with the best and the poorest records in high school had 
higher scores than their counterparts in the middle range. Kr 
the Deduction score of the Critical Thinking Appraisal, studentrj 
with the best high school records had the highest scores, and 
r3tudents with the poorest hi/^h school records had the lowent 
scores. As was found with prior college experience, there wore 
no significant indications of a differential rah'> of chan/^e dije* 
to high school grade level. 
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Marital status ' accounted for difference^j during the first two 
years on the Test of Thematic Analysis. Married students scored 
higher than single students on this measure.- 

While each of these relationships is interesting in its own 
right, we have not explored them further in this report. Without 
a more complete analysis of sources of variance unique to each 
input characteristic, it would be misleading to draw conclusions 
about the practical significance of the differences noted between 
amounts of prior college experience, high school grade levels, 
and marital" status categories. Our main . interest at this point 
is to identify variables as covariates with entrance assessments 
that explain variance in second assessments two years later, so 
that they may be taken into account in exa'nining the effects of 
the learning process on student development. 

^rogr.am Covariates 



The fourth and fifth columns of Table 26 show the results of 
tests for additional variance in second assessiaents due to 
differences in type of college experience (viz., entrance cohort, 
residence, part-time vs, full-time status, and major) coincident 
with involvement in the learning process (see Appendix. I,^ Table 
Y). Entrance cohort was found to account for significant 
increments in variance on three measures. For the "Best Class 
essay of the Measure of Vocational, Educational, and Personal 
Issues, entrance cohort not only accounts for additional variance 
itself, but also interacts with prior college experience to 
account for a total of 15.3^ of the variance in second assessment 
ratings left unexplained by entrance i-atings alone. Generally 
speaking, there were different affects of prior college 
experience among the three entrance cohorts. For th^e reasons 

already stated, these differences are not probed here. Entrance 
cohort differences are also detected on the Sentence Com>pletion 
Test of Ego Development, and the Affiliation Motive score from 
the Picture Story Exercise. No interaction affects were found to 
suggest differential rates of change. 

Differences in residence status and major were aach 
identified as covariates on two measures. For both of th^^se 
categorical variables, a switch in status between assessments was 
assigned a value equal to other categories. While this tack made 
It possible to more thoroughly evaluate sources of covariance for 
present purposes, it makes interpretation of the differences 
found more difficult. For example, differences in residence 
during the first two years accounted for significant variance in 
"Decision" essay ratings at second assessment beyond variance 
explained by entrance assessment ratin^^ and age. This 
additional variance was related to categories defining changes in 
residence durin^^ the first: two years ( i .e s t ud ts idontlfled as 
resident students at entrance, bat who wc»re Identified ari 
commatlnf.'; at tlie time of second assessment, and visa versa. Thus 
this variance cannot be attributed to diff(>rent experiences or 
characteristics of resident or commuting students, but belongs to 
some constellation of unknown factors which resulted in students 
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changing from one status to the other. The same ambiguity 
surrounds the significant relationships with major, for whiph a 
single category defined a group of students who changed majors 
between entrance and second assessment. As was true for all 
covariates^- previously noted, no significant interactions wit)i 
en trajiee' assessments were found. 

Differences Between Intervals 

In most cases. Table 27 shows that the relationship between 
second and third assessments on each measure was stronger than 
between first and second assessments. That is, a higher 
percentage of variance in the post-interval measure was explained 
by the pre-interval measure. Several factors may contribute to 
stronger pre-post correlations in the second interval. 
Generally, more change, unless it happens to be uniform change 
across students, means lower correlations between pre-post 
measurements. Considering the change factor alone, the relative 
strength of correlations for each interval conforms, for the most 
part, with the results of the repeated measures analyses for each 
interval. Where the repeated measures analyses included overall 
change during the first interval, but not during the second 
interval, the correlation between first and second assessments 
was weaker than the correlation between second and third 
assessments. Other factors, such as test familiarity and scoring 
procedures, may of course also play a part. 

There were several relationships between second and third 
assessments which included a significant quadratic element. On 
the "Career" essay of the Measure of Vocational, Educational, and 
Personal Issues, the Assertive Stage of Adaption score from the 
Picture Story Exercise, and the Abstract Conceptualization scale 
of the Adaptive Style Inventory, the quadratic contribution was 
negative--including a "ceiling effect," or lower third assessment 
scores for students on the high end of the scale at second 
assessment. In the remaining cases, the quadratic element 
functioned as part of the total equation to show the actual 
sijnilarity of pre-post interval scores for students at the higher 
end, while the relationship of lowered scores was less 
predictable. 

There were no instances in which background variables 
contributed to the relationship between second and third 
assessments, except for marital status on the Adaptive Style 
Inventory. Single students had significantly higher preference 
for Reflective Observation than did divorced and widowed 
students; the means for married students and students who changed 
status during the interval were closer to the means of single 
students. 

Among differences in types of college experience, entrance 
cohort was found to be a significant covariate on twice as many 
measures the second interval. Major was not a significant 
covariate on any measure. There was not one case in which the 
same program variable acted R'J a significant covariate in botli 
intervals. 
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For the second interval, which is equivaJftnt to the 
pre-professional sequence for the typical student, program 
covariates were identified in five of the twelve measures .(see 
Appendix T, Table Z) . These covariates, together with second 
assessment performance, account for a range of '^.2% to 44.6^ of 
the variance in third assessment performance. 

"Value Added" by Time and Performance in CaUlege 

Studies of time and performance in college were introduced in 
a preceding section. The three variables are, (l) number of 
semesters enrolled, (2) number of credit hours accumulated, and 
(3) number of competence level units accumulated. Cach variable 
represents a different aspect of involvement in the learning 
process. The purpose of the present analysis is to examine the 
outcoiaes on the human potential measures when previous level of 
performance, and background and , program . covariates, are 
controlled. The partialed relation.ships between these indices, 
and developmental change as recorded ^^'ith the human potential 
measures, provide our best understanding of the "value added" to 
student development by involvement in the Alverno learning 
process. 

A larger part of the variance in semesters attended, and 
credits and competence units accumulated, is related to 
differences in type of college experience. This could be 
particularly true of differences in part-time/full-time status, 
and major. Because of the difference in time-frame between 
Weekday and Weekend programs, entrance cohort might also be 
expected to account for differences in the college performer 
variables. Background variables may also explain differences, 
though it is likely that most of this variance is already 
accounted for in program variance in college performance. 

The significant relationships of college performance in the 
first interval to program and background variables are shown in 
Table 28. 



Table 28 



Correlations of Time and Performance in the First Interval 
With Background and Program Covariates 



P/F 



Ma j or 



ECo 



BV, if any 



Semesters 



Major 



Cred it3 



P/F 



Ma j or 



CLUs 



P/F 



Major 



Father s 
Fdiicat ion 
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Major accounts for 10. 4^ of the variance in number of 
semesters between entrance and second as^jessments* 
Part- time/full-time status, major, and entrance cohort together 
account foi* 71 .4^ of the variance .in number of credits 
accumulated in the first interval. Part-time/full- time status 
and major account for 44*6^ of the variance in competence level 
units accumulated between ejitrance and second assessmeni;. 
Interestingly, father's education explains an additional 4*1^ of 
t'Te variance in competence units over and above the prograjn 
variables. 

The involvement of students during the second interval might 
be expected to depend on the extent of their involvement during 
the first two years. Table 29 shows the relationships of 
involvement during the second interval to program variables, with 
first interval performance controlled. 



Table 29 



Cor*relations of Time and Performance in the Second Interval 
With Background and Program Covariates and Controlling 
for First Interval Differences 



Interval 1 P/F Major ECo 
Semesters Semesters ECo 

Credits Credits + Credits2 P/F Major 

CLUs - P/F Major 



No background variables contribute significantly to the 
variance in second interval involvement beyond what is explained 
by first interval involvement and program differences. The 
number of competence level units accumulated during the second 
interval was not significantly related to the number accumulated 
during the first interval. Part-time/full-time status and major 
accounted for 26.0^ of the variance in competence level units 
accumulated between second and*' third assessments. Credit hours 
accumulated during the first two years, part- time/full-time 
status, and major, explain 62.8^ of the second interval variance 
in credits. The number of semesters attended between second and 
third assessments was related to number of 'semesters attended 
during the first interval and to entrance cohort, with these 
factors explaining 7.6% of the second interval variance. 
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Contributions of Time and Performance to Change 

By correcting the .college performance indices for 
program-related differentials, we can obtain the most, accurate 
picture of the unique participation of involvement in the 
learning process to variance in student outcomes on the human 
potential measures. If these differences are not controlled, the 
partial correlation between the college performance indices and 
student change on the human potential measures will in most cases 
appear weaker than is actually the case, although the opposite 
(i.e., a strong but superior relationship) 'may also occur. 



Between Entrance and 
Second Assessment 

Table ?0 shows the measures on which involvement in the 
Alverno learning process explained variance in second assessments 
not related \o entrance measures or background and program 
covariates. Again, the question mark signifies a probability 
level between .05 and .10. Parentheses indicate significant 
partial correlations that were of a lower order of magnitude than 
the strongest relationship (shown in parentheses). In the first 
interval, there were only two instances in which the index of 
performance in the competence-based curriculum explained variance 
above and beyond the causally antecedent, or coincident, factors 
(i e., the Test of Cognitive Development and the Reflective 
Observation sample of the Learning Style Inventory). Five other 
relationships with competences .approached significance, the 
score of the Defining Issues Test, and the Abstract 
Conceptualization score of the Learning Style Inventory. 

Student outcomes on the Test of Cognitive Developnent during 
the first two years provide an example of the most common case. 
Entrance scores on this measure accounted for 22.1% of the 
variance in scores two years later. Different levels of 
performance attributed to past academic scores (high school 
grades) accounted for an additional A^3% of the variance in 
second assessments. Differences in type of college experience 
did not account for any significant variance in second 
assessments that could not be explained by entrance scores and 
high school grades. (These findings were presented above in 
Table 26.) We have just seen the extent to which number of 
semesters attended, number of credit hours completed, and number 
of competence level units accumulated, were explained by 
differences in ':ypes of college experience (in Table 28 above). 
Having established that the program variables were not related to 
student change on the Test of Cognitive Development, we know that 
the varla]bility in college performance related to program 
differences cannot be related to change on the Test of Cognitive 
Development. When ohis portion of the variance is not exr^luded 
from analysis of the covariance between college performance and 
change in the Test of Cognitive Developnent, it has the effect of 
weakening the obtained correlations. 
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Table 30. 

College Performance Variables Related to Chanp.t. for Each 
Interval of Assessment 



Measure 



Measure of 
Vocational* 
Educational, and 
Personal Issues 

Sentence 
. Completion 
Test 
Moral , Judgment 
Instrument 



"Best Class" Essay 
"Decision" Essay 
"Career" Essay 



Def Ining 
I ssues 
Test 

Test of 
Cognitive 
Development 

Picture 
Story 
Exercise 



Learning 
Style 
Inventory 



Adapt ive 
Style 
Inventory 



Test of 
Theraat ic 
Analysis 

Analysis 
of Argument 

Critica'l 
Thinking 
Appraisal 

Life History 
Exercise 



PZ Score 
D Score 



Stages of Adaptation 
Kecf ive 
Auf Vinous 
Asi> ft ive 
Integrative 

Self-Definition 

Achievement Motive 
Affiliation Motive 
Power Motive 

Concrete Experience 
Reflective Observation 
Abstract Conceptualization 
Active Experimentation 

Abstract/Concrete 
Learning Orientation 

Active/Reflective 
Learning Orientation 

Total Concrete Experience 
Total Reflective o'tservation 
Total Abstract Conceptualization 
Total Active Experimentation 

Abstract/Concrete 
Adaptive Orientation 

A-tlve/Reflective 
Adaptive Orientation 



Attack 
Defense 

Inference 
Recognition 
Deduct* Ion 

Performance 
Improvement 



24. J 
18.0 
20.0 

17.3 

23.6 

26.8 
44.1 

27.0 



XXX 

2.2 
6.3 
6.1 



2.2 
14.1 
5.1 

6.2 
9.7 
19.1 
19.8 

14.0 
18.4 

N.A.; 

N.A. 
N.A.' 



1st and 2nd 

College 

Performance 



U 4J 



18.5 



XXX 
XXX 

23.3 
13.4 
34.9 

23.0 

XXK 



Clu 



Clu 



B a 

O -H 

u u 
cu > 



Clu 
Clu ? 



Clu 



3.4 



2.0 



1.7 



Cre 



o 

V ; 

C I 

C -H 1 

U p. ( 



^5 



3rd 



2nd and 
College 
Performance 



0 u 

V 

1 g 

z in 



c B 



3.4 
8.9 
16.1 

24.2 

44.6 

33.6 
41.3 

32.6 



XXX 

3.2 
6.0 
16.0 

4.2 

6.2 
5.8 

XXX 

16.6 
30.9 
13.5 
30.0 

13.4 



40.0 

31.0 
23.6 
25.8 
24.7 

36. 7 
33.0 



5.8 



XXX 
XXX 

29. 3 
25.0 
33.2 

20.2 

XXX 



Cre"^? 



Clu ? 



Clu 



Clu"*"? 



9.8 



Cre 



Cre 



Sem 



2.0 
2. 7 



Clu"*"? 



Cre 



Cre 



1.8 



1.9 



CU 



Cre"*"? 



Cre 



Cre 



Sem 



2.0 



1.6 



4.3 



Nojc. ^I.A. - N-t Applicable. StudentB vere not given thl« measure at time of first aB«emiment. 
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When the variance in college performance attributed to 
program differences was not excluded, the partial correlations of 
the three performance indices with variance in second assessments 
left unexplained by entrance assessments and high school grades 
were: .154 ^ for number of semesters; * 1 20 < for 

credit hours completed, and .171 < for competence level 
units accumulated. With the variance excluded, the partial 
correlations were, respectively, .152 (_£ < .05)r .180 (_£ < .05), 
and .228 < .001 ). 

Of course the opposite result can occur. In several scores, 
there was some relationship between types of college experience 
and human potential measure outcomes, but simply not enough to 
make a judgment of a significant relationship. The Principled 
Thinking score (P^) from the Defining Issues Test provides such 
an example. Residence, part-time/f ull-time status, and major all 
showed some relationship to ?% scores at second assessment beyond 
variance explained by entrance scores. However, none of the 
relationships were strong enough to be identified as significant 
covariates. When the variability between these variables and 
college performance was included in computing the partial 
correlations between college performance indices and change on 
the ?% score of the Defining Issues Test, the partial 
correlations were: .025 (_£ < .1) for number of semesters; .188 
< .05) for credit hours completed, and .237 (_£ < .01) for 
competence level units accumulated. With this variance excluded, 
the partial correlations were, respectively, .014 (_£ < .1), .134 

(2 < .1 ) and .144 < .1 ). 

Comparisons of partial correlations using raw and corrected 
forms of the college performance variables are presented in 
Appendix I, Tables AA and BB. Significant relationships, using 
the corrected performance variables were presented in ' Table 30. 

Between Second and 
Third Assessment 

Table 30 also presents relationships between the college 
performer indices and variance in third assessments unexplained 
by second assessments and other covariates. The number of 
significant or nearly significant relationships suggest that 
involvement in the learning process had a much broader impact on 
change during the second interval, though as we said earlier, 
there was decidedly more change occurring during the first two 
years. 

Time in College 

In the second interval, the number of semesters attended 
accounts for variance on two measures, the Asoertive Stage of 
Adaption from the Picture Story Exercise and the Test of Thematic 
Analysis. In both cases, the relationship is negative, 
indicating that students attending more semesters in the second 
interval (than were predicted from the first interval atteniance 
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and knowledge of entrance cohort) received scores at third 
assessment that tended to be lower than predicted by their second 
assessment scores. Most students attended four or more semesters 
in both intervals, and very few attended less. Five semesters 
was the maxi um a student could attend in the third interval, and 
the fifth -»:»mester would have had to be in summer school. It 
would seem to follcw that those students who attended Alverno 
constantly in the second interval, but had attended four or fewer 
semesters in the first two years, performed lesR weJ 1 on the 
Test of Thematic Analysis, and became less assertive. 

Performance Indexed 
by Credit Hours 

A number of significant and nearly significant partial 
correlations were found between outcome measures and nuirber of 
credit's in the second interval. There was a large positive 
correlation between number of credit hours completed in the first 
interval and credit hours completed in the second interval. 
Together with knowledge of part-time/full-time status and major, 
first interval credits predicted 62.8^ of the variance in second 
interval credits. The partial correlations reported in Table 30 
are, again, correlations between variance in second interval 
credits unrelated to these predictors, and variance in third 
assessment outcomes unrelated to second assessment outcomes and 
other sources of covariance. 

Nearly significant partial correlations were found between 
the otherwise unexplained variance in second interval credits and 
two cognitive-developmental indices. Both partial correlations 
were positive, suggesting students completing more credits (than 
were predicted by credits completed in the first two years, 
major, and student status) tended to have higher third assessment 
scores than were predicted by second assessments. In the case of 
the "Decision" essay from the MVEPI , there was an average decline 
in. ratings from second to third assessment. The relationship 
between outcomes on this measure and credits completed in the 
second interval suggests that earning more credits in the second 
interval, relating to credits earned in the first two years, 
tended to offset this loss, if not contribute to additional 
development of perspective in decision-making. For the D score 
of the Defining Issues Test, there was no mean difference in 
scores between second and third assessment. In this case the 
relationship suggests a positive increment in moral development, 
as defined by the measure, for those who earned relatively more 
credits in the second interval. 

Negative partial correlations were found between crer^its and 
two stages of Adaption indices from the PSE. The nearly 
significant negative relationship between credits and the 
Assertive Stage of Adaption may well be spurious (i.e., it can be 
accounted for in the stronger correlations with both semesters 
and competence level units). The negative relationship between 
•credits and the Autonomous Stage of Adaption was significant, and 
indicates that students earning more credits, relative to the 
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first two years, had lower scores than were predicted by second 
assessment. In the context of the scheme of Stages of 
Adaptation, lowering scores on second and third stages could 
conceivably be taken as signs of positive development. If that 
is so, it is uncorroborated by a corresponding increase in scores 
on the Integrative Stage of Adaptation. 

Number of credits completed i:. the second interval was 
negatively correlated with change in preference for Concrete 
Experience as a component of the Learning Style Inventory. The 
relationship holds for the composite index wi th Abstract 
Conceptualization. The relationship is positive for the 
Abstract/Concrete index of course, since the Concrete Experience 
score is subtracted from the Abstract Conceptualization score. A 
different set of relationships appear in the presumably cognate 
Adaptive Style Inventory where credits earned were positively 
correlated with Total Reflective Observation, scores, and 
negatively correlated with Total Active Experimentation scores. 
When there are two scales combined, the relationship with credits 
is negative. 



Performance Indexed^- 
by Competence Level 

In contrast to the other college performance variables, the 
number of competence level units accumulated between second and 
third assessments ^as not significantly correlated with the 
number . .'cumulated in the first two years> Second interval 
competence level units were . controlled only for major and 
part-time/full-time status. It is interesting to note (Appendix I, 
Table BB) that several of the small partial correlations 

between the cognitive-developmental measures and competence level 
units in the second interval are opposite"" in size from the 
. partials between cognltive^developmental measures and credits. 
At the same time, there was a strong positive zero-order 
correlation between competence level units and credits (+.595)* 
For the Sentence Completion Test of Ego Development, there was 
nearly significant negative partial correlation with competence 
level units, and no correlation {^L ^ -^OS) with credits. The 
opposite was true for the correlation between the "Decision" 
essay of che MVEPI noted earlier. There was no ' correlation 
between the "Decision" essay ratings and competence level units 
( pr = .006). 

For the smaller group of students who completed the Moral 
Judgment Instrument, the divergent effects of credits and 
competence level units accumulated in the second interval means 
lower Moral Maturity scores than were predicted by second 
assessments. When competence level units were controlled, the 
positive partial correlation with credits bec^une significant ( pr 
= .461, F (1, 36) = 9.71, p < .01). 

The effects of relatively more competence level units on 
third assessments of the Assertive Stage of Adaptation are 
consistent with those reported for semesters and credits. This 
appears to be the only case in the second interval (as the Test 
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of Cognitive Development was in the first interval) where all 
three '.indices show a common effect. 

Nearly significant positive partial correlations were found 
between the competence index and Achievement Motive scores, and 
the Active/Reflective composite score of . the Learning Style 
Inventory. 

Summary of the Causal Analysis of Change 

It is difficult to summarize the effect/ o| involvement in 
the Alverno learning process (i.e., the , /Value .added to student 
development) from the analyses of individual measures. Each 
significant or nearly significant partial correlation suggests- 
some value added, but the data do not, at first glance, indicate 
a distinctive pattern of relationships unique to one college 
performance variable or another. The general impression of 
practical significance is that involvement during the second 
interval, relative to the first, seems to make more of a 
difference in second interval outcomes, even though less overall 
change occurs than in the first two years. 

To gain further insight, we must move to the third purpose of 
this section of the study, the examination of interrelationships 
among the human potential measures. Unfortunately, comparing 
relationships among all measures is rife with difficulties 
related to .ncomplete data, and a host of confounding 
experimental and statistical considerations. Several different 
kinds of judgments were necessarily imposed which-mu3t be taken 
into account in interpreting the results. In any event, the 
results reported below should be interpreted with extreme 
caution, and only in the context of the limitations and judgments 
discussed below and in the analysis plan. 



Re la t i o nships Among Human Potential Measu res^ 
Analysis of Entrance Assessments 
Bivariate Relat ionships 

The correlations among human potential measures from entrance 
assessments afford the best view of relationships among measures, 
unaffected by college experiences or possible effects ol 
■familiarity with the instruments. A complete table of 
intercorrelations of entrance assessment measures is provided in 
Appendix I, Table CC. Table 31 below shows the significan'; 
correlations among entrance assessments for the 
cognitive-developmental measures. (The D score of the Defining 
Issues Test has been omitted' from this table, and. from the 
following factor-analytic results, since it Vs mathematically 
related to the Principled Thinking index from the same 
instrument. The Moral Maturity score is also exc luded from Table 
31 and from the factor analyses due to the small number of cases 
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inv^ ved.) Only three. of the relationships among the measures in 
Tabl 31 were not significant. Consistent with psychological 
measurements of this sort, all of the correlations are in the low 
to : moderate range. Casual inspection suggests two factors 
operating among the selected measures^ distinguished by the 
Measure of Vocational, Educational, and Personal Issues on the 
one hand, and the Test of Cognitive Development on the other. 
The Sentence Completion Test of Ego Development .and the Defining 
Issues Test appear to share in- both. Considering the theoretical 
structure of these measures, thie pattern of correlation suggests 
a separation between soc io-emovional maturi ty and logical 
thought. 

There were very few significant bivariate relationships 
between the cognitive-developmental measures and the Stages of 
Adaptation measure from the Picture St^ry Exercise. Autonomous, 
Assertive, and Integration stage scores were all correlated with 
the "Best Glass" essay rating from the Measure of Vocational, 
Educational and Personal Issues, which may reflect the common 
scoring emphasis on relationships to, and attitudes towards, 
authority. The lack of other correlations between the 
cognitive-developmental measures and the Stages of Adaptation led 
us to question the latter* s role as a developmental measure. In 
terras of convergent vs. divergent validity, the Stages . of 
Adaptation would ideally show stronger correlations with other 
developmental measures obtained through different methods of 
measurement, than with less developmental measures obtained by 
similar methods of measurement. 



Table 31. 

Significant Correlations Among Entrance Assessments 
for Cognitive-Developmental Measures 



Measure 




2 


3 


4 


5 6 


w 
'> 


(1) Best Class Essay 

(2) Decision Essay 


..311 












(3) Career Essay 


.203 


.365 








IDS 


(4) 


. .186 




.278 






DIT 


(5) P% Score 




.212 


.277 


. 325 




TCD 


(6) 


.127 




.193 


.243 


.349 ' — 
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Table 32. 





Signif icanl 


Co r re la t Ions Between 


Cogn If ive-Dovelopment n 1 






and Generic Ability 


Measures ' 




1 


'est of: Themat ic 




Critical iliiiiiCing Appraisal 


Me^isure 


Analysis 


In 


ference Recognition DeducMon 




Best Class Essay 










Dec is.Lon F'Jssay 






.140 .150 




(!areer Essay 


.139 




.179 






.253 




. 170 














P7, Score 


.185 




.351 .295 


a 










u 




.295 




.276 ,212 .352 
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There vfere few significant bivariate relationchips!) between 
the cognitive-developmental measures and the other 
characteristics measured by the Picture Story Exercise, or with 
the Learning !?tyle Inventory. Achievement Motive scores were 
correlated only with the "Best Class" essay ratings from the 
Measure of Vocational, Educatonal, and Personal Issuos (_r = 
-.154, £ < .02). \ Affil1,4tion Motive scores were correlated with 
the Sentence Completion/Test of Ego Development ^ = .193> £ ^ 
.01) ard with the 'Principled Thinking index of the Defining 
Issues Test (_r = -.139> < .05). Learning Style composites, the 
Abstract/Concrete scale and the Active/Reflective scale, were 
correlated with the Test of Cognitive Development (t = .131 and 
-.149, respectively, jd < -05). 

The bivariate relationships between cognitive-developmental 
measures and the generic ability measures lend support to the 
distinction suggested by ■ the intercorrelations of 
cognitive-developmental measures. Table 32 presents the 
significant correlations between the cognitive-developmental 
measures in Table -31 and the entrance assessments from the Test 
of "^hematic Analysis and the Critical Thinking Appraisal. 
(Entirance assessments on the Analysis of Argument and Life 
History Exercise were not available for all three cohorts.) The 
generic ability measures correlate most strongly with the cluster 
of cognitive-developmental measures more associated with logical 
thought. Inspection of the full correlation matrix in- Table CC 
c r Appendix I reveals a few significant but low correlations with 
motive, learning style, and ability measures. (All ind ices 



excluded from this presentation because of incomplete data or 
mathematical interdependencies can be reviewed in the Appendix.) 

P r i ncipal C ompon ent Ana lysis 

Table 33 presents th^^ results of a principal component 
analysis of entrance measures orthogonally rotated to maximize 
the variance between variables on each component. Eight 
components were selected, based on the criterion that a component 
account for more of the total variance , than was provided by a 
single variable. This analy sis, presented for descriptive 
purposes , includes all entrance measures available ac ross 
cohorts. (The D score from the Defining Issues Test and the four 
subscales of the Learning Style Inventory have been excluded 
because of their mathematical interdependence with the included 
indices from those instruments.) 

A common rule of thumb for evaluating the significance of 
factor loadings is to consider loadings of 0.3 or more as 
worthy of special note. Because this is only a rule of thumb, 
all loadings are shown in Table 33 and the loadings exceeding this 
criterion have been underscored. 

Ordinarily, the first component is considered the most 
important, with later components important in decending order. 
The orthogonal rotation confounds this somewhat, and shifts the 
focus on rank to 'a focus on the conceptual identification of 
components. With the variables given, the 

cognitive-developmental measures are split into more than the two 
clusters suggested by casual observation of their 
intercorrelations. The link between the logical thought aspect 
of the cognitive-developmental measures and the generic ability 
measures is evident in the first component. What appeared to 
have been a second cluster has been broken into Components 3 and 

The Stages of Adaptation indices, lacking significant 
bivariate correlation w^th variables other than those from the 
same instrument, each loaded on separate components (2, 4, 5 and 
7). It is not clear of course how responsible these indices are 
for the dispersal of cognitive-developmental loadings on 
Components 3, 4 and 5, nor is it clear how the Self-Description, 
Motive SCO res, and Learning Style Inventory composite indices 
might load with cognitive-developmental or generic components 
apart from the influence of the Stage of Adaptation indices 

Table 34 answers that question by showing the results of an 
identical analysis of entrance assessments with the Stages of 
Adaptation indices excluded. 

The number of components accounting for more variance than a 
single variable is reduced to six. The cognitive-developmental 
components, 2 and 5, come much closer to matching the clustering 
evident in the bivariate relationships. The loadings of the 
Sentence Completion Test and Defining Issues Test on the second 
component are close to the rule of thumb criterion (.279 and 
.271, respectively). The loadings of the Test of Cognitive 
Development on Component 1 (.287), and of the critical thinking 
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Table 33. 

I 

Factor Loadings from Principal Component Analysis of Entrance Assessments 



Measure j 12 3 4 



Best Class Essay 


-.038 


-.180 


.795 


.073 


-.071 


.073 


.168 


.268 


Decision Essay 


.146 


.058 


.701 


-.055 


.085 


.027 


-.034 


-.198 


Career Essay 


.136 


.146 


.519 


-.206 


.106 


.323 


-.252 


-.234 




06S 


029 


.144 


-.074 


-.024 


.799 


-.026 


-.012 




/iSl 

1 '-t J 1 


t I 4 J 


185 


- 412 


-.030 


.374 


-.053 


-.017 




* J J J 


• I. J, w 


,133 


.021 


.017 


.315 


-.163 


.241 














• 




-.128 


Receptive 


.187 


.009 


.012 


.749 


-.113 


-.042 


.099 


Autonomous 


.081 


.315 


.147 


-.044 


-.137 


ATT 

-.037 


. 735 


. 113 


Assertive 


-.160 


.767 


-.093 


-.087 


.039 


-.011 


-.027 


.009 


[ntegrat ive 


.011 


.058 


.237 


.187 


.767 


.063 


-.011 


.073 


i: .■^Lf-DGfinition 


.126 


.330 


-.051 


.594 


.258 


-.093 


-.192 


.159 


Achievement Motive 


.215 


-.022 


-.180 


-.290 


.708 


-.182 


.076 


-.020 


Af fi] iat ion Motive 


-.229 


-.416 


-.136 


.458 


-.040 


.477 


-.126 


-.012 


Power Motive 


.023 


.738 

L- 


.061 


.222 


-.016 


.066 


.200 


-.043 


rVDSL 1 aL L/ ^onc^eLe 


.042 


-.005 


-.068 


-.050 


.048 


.068 


-.025 


.841 


I t":* n rn 1 n a 1 1 r "i pti ^ ^5 1' inn 














Active/Reflective 


-.170 


-.087 


-.151 


.037 


.334 


.103 


.631 


-.217 


















.318 


-.021 


.004 


-.026 


-.050 


.532 


.242 


.187 


Inference 


.700 


.028 


.131 


-.010 


.069 


-.034 


-.035 


-.124 


Recognition 


.649 


-.179 


-.128 


.122 


.056 


-.005 


.146 


-.093 


Deduction 


.690 


-.065 


.071 


.105 


.044 


.135 


-.060 


.191 
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Tables 34. 



I'actor Loadings from Revised PrincLpal Comi)anenL Analysis 
of l-ntrance Assessments (excludinij; Stai;es of Adaptation) 





Measure 


! 1 


2 


3 


4 


5 


6 


M 


Best Class Essay 


-.077 


.563 


. 212 


-.006 


.143 


-.254 


w 


Decision Essay 


.153 




-. 053 


.058 


-.010 


.018 




Career Essay 


-.008 


654 


-.184 


-.021 


.262 


-.022 


H 
U 
CO 




-.012 


. 279 


. 289 


-.131 


. 615 


-. 058 


n 


Pa Seoru 


. 1 3 3 


. 271. 


-._3_j_9 


-.126 


.601 


-.010 


TCD 




.287 


.073 


-.143 


.181 


.585 


-.253 




Sel f-Def in i tion 


.219 


-.114 


. 086 


.744 


-.117 


-.134 


PSI 


Achievement Motive 


.400 


-.156 


-.454 


-.158 


-.104 


. 291 


Affiliation Motive 


.074 


-. 068 


.841 


-. 100 


.057 


. 042 




Power Motive 


-.1 60 


.135 


-. 162 


. 775 


.117 


.229 


LSI 


Abstract/ Concrete 

Learning Orientation 


-.074 


-.402 


-. 024 


.085 


.4 39 


-.285 


Act ive/ Re fleet ive 

Learning Orient^ition 


-.071 


-. 084 


.008 


.070 


. 029 


.852 


< 
H 




.17 3 


.021 


.146 


.010 


._62_8 


.132 


CTA 1 


In f erence 


.541 


.161 


-. 318 


.001 


.205 


-.138 


Recognit ion 


. 799 


-.003 


.125 


-.022 


.034 


.092 


Deduct ion 


.644 


. 070 


. 015 


.168 


. 329 


-.174 
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measures in Component 5 (Test of Thematic Analy:- :,;-; , .628; 
Deduction score from the Critical Thinking Appraisal, .329) 
indicate the linkage between critical thinking and the logical 
thought aspect of the cognitive-developnental meap.ures. With 
Stages of Adaptation removed, we also find ..nteresting 
interrelationships between the other measured characteristics and 
the cognitive-developmental and critical thinking measures. 

Correlated Factors Solution 



The principal component solution in Table 34, though perhaps 
more suggestive of interrelationships between measures than the 
preceding solution, is of limited value in interpreting 
underlying factors because of the forced independence of the 
components, and because the total variance is factored into 
components rather than just the common variance. One would 
expect each measure to include variance in common with other 
measures, plus unique variance and error variance. When just the 
variance each measure shares with one or more others was 
factored, and factors v/ere allowed some degree of correlation, 
the results in Table 35 were obtained. Table 35 presents the 
obliquely rotated factor pattern matrix from a factoring method 
(Alpha factoring, Nie, et:,ai.,1975) which treats the included 
variables as a sample from the universe of variables 
characterizing the develojnent and abilities of the population. 

The factor pattern matrix most clearly identifies the 
clusters of variables measuring siniilar characteristics in the 
population. A substantive interpro tation of the factors requires 
examination of the actual correlations between factors and the 
original variables, and the correlations between the factors 
themselves. In Table 35, the matrix of correlations of factors 
with variables, the factor structure, is shown to the right of 
the pattern matrix, and the intercorrelations among factors are 
shown below. 

The first factor appears to be a general 
cognitive-developmental factor most significantly related to the 
four instruments underscored in the factor pattern matrix (Table 
35). It is positively correlated with all of the included 

cognitive-developmental and critical thinking indices, and with 
the Abstract/Concrete dimension of the Learning Style Inventory. 
The second and third factors are each principally defined by the 
multiple indices of a single measure. 

The correlations show that while both provide some measure of 
general cognitive development, they seem to identify different 
components of cognitive development that may be exhibited 
independently. The second and third factors are uncorrelated, jr 
= -.01 , though both are positively correlated with the first 
factor, ~ -22 and .24, respectively. The second factor 

indicates critical thinking, but not necessarily socio-emotional 
maturity while the third factor represents socio-emotional 
maturity without the exhibition of critical thinking. 

The fourth factor, which may represent self-assertion, is 
defined by measures of Self-Definition and the Power Motive. 
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Measure 


Pattern Matrix 
Factor 


Structure Matrix 
Factor 


1 


2 


3 


A 


5 


6 


1 


2 


3 


A 


5 
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Measures of Vocational, educa- 


























tional and Porsonal Issues 


























"Eost Class" Essay 
",'Je< Is Int." ?.i\fi!iy 
"flarccr" Essay 


. lA 

-.05 
.15 


-.10 

. n 

-.00 


jJl 
.6A 
. 53 


-.00 
.07 
-.02 


-.19 
-.OA 
-.05 


.11 
-.00 
-.12 


.25 
.lA 
.28 


-.08 
.10 
.05 


. 35 
.62 


-.02 
.03 
-.03 


-.25 
-.09 
-.12 


.13 
-.07 
-.15 


Sentence Completion Test 




-.C2 


.22 


-.08 


.OA 


.19 


.A9 


.03 


. 31 


-.09 


-.11 


.19 


Defining Issues Test 


















J 








PZ Score 




.06 


.19 


-.11 


.01 


-.29 


. 55 " 


.21 . 




-.07 


-.10 


-.29 


Tost of Cognitive Development 




.15 


.01 


.13 


-.22 


-.13 


.58 


.30 


.13 


.20 


-. 36 


-.13 


Picture Story Exercise 


























Self-Definition 


-.09 


. 13 


- . 09 


. AA 


— .10 


0 3 


- . 03 


. 15 


-. lA 


.A6 


-.11 


-.01 


Achievement Motive 
Affiliation Motive 
Power Mot ive 


-.03 
.05 
.08 


.28 
.10 
-.16 


-.10 
-.05 
.19 


-.OA 
-.05 
.67 


.19 
.OA 
.2A 


-.25 
. 71 
-.07 


-.05 
.07 
.06 


.31 
-.03 
-.10 


-.10 
-.03 
.15 


-.02 
-.08 
.6A 


.21 
-.OA 
.18 


-. 31 
.70 
-.11 


Learnin>? Style Inventory 


























Alistract /Concrete 

Learning Orientation 


. 22 


-.01 


-.19 


. 05 


-.09 


.01 


.20 


.05 


-.lA 


.08 


-.lA 


.OA 


Act ive/Ref lect ive 

Learning Orientation 


. OA 


-. 01 


-.OA 


.OA 


■ AA 


.02 


-.09 


-.03 


-.07 


.01 


.A3 


-.02 


Test of Thematic Analysis 


.A9 


.10 


.00 


-.00 


.07 


.09 


. 50 


.19 


.10 


.02 


-.08 


.08 


Critical Thinking Appraisal 


























In forence 
Recognl't ion 
Deduct ion 


. 12 
.01 
.26 


.30 
.65 
'.A9 


.15 
.05 
.02 


.01 
-.02 
.15 


-.12 
. 05 
-.18 


-.21 
.13 
.02 


.27 
. .16 
.AA 


.A6 
.62 
. 56 


.19 
.03 
.08 


.06 
.01 
.21 


-.17 
-.02 
-. 31 


-. 27 
. 00 
-.05 



Factor Correlation 
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1 
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2 


.22 










Factor 


3 


.2A 


-.01 
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A 


.06 


.07 


-.07 






Factor 


5 


-.28 


-.0? 


-.07 


-.07 




Factor 


6 


.03 


-.19 


-.07 


-.06 


-.09 
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This factor is virtually independent of the other factors. The 
small positive correlation with the Test of Cognitive Development 
(£ = .20) and the Deduction score of the Critical. Thinking 
Appraisal {r = .21) in Table 35 suggests that the mutual 
occurrence of high Self-Definition and high Power Motive i.=5 
associated with an element of deductive thinking ability. 

The fifth and sixth factors are distinguished by their 
negative correlation with the first two factors. The 
Active/Reflective dimension of the Learning Style Inventory, 
which is most prominent on the fifth factor, was negatively 
correlated with most of the cognitive-developmental and generic 
ability indices. The fifth factor is thus negatively correlated 
with the first general factor of cognitive development. Besides 
the Active/Reflective Learning Style score, the only variables 
positively correlated with the fifth factor were the Achievement 
and Power Motives (r = .21 and .18, respectively). The strongest 
negative correlations were with the Test of Cognitive Development 
{r_ = -.56), and the Deduction score of the Critical Thinking 
Appraisal = -.31). Factor 5 would seem to identify a 

characteristic that might be commonly recognized as *'doing," that 
is unrelated to cognitive-developmental pattern. 

The Affiliation Motive stands out on the sixth factor, which 
vShows some negative correlation with the second, or logical 
thought factor. The impression that this factor represents a 
characteristic of concern with interpersonal relations is 
supported by the positive correlations with the "Best Class'* 
essay rating from the Measure of Vocational, Educational, and 
Personal Issues (j^ = .13) and the Sentence Completion Test of Ego 
Development (_r = .19). Both of these indices reflect, in the 
upper range of ratings received by the population, a growing 
interpersonal sensitivity. 

One additional check on the interpretations of these factors 
is provided by inspection of the correlations of factors with 
human potential measures excluded from the factor analysis. 
Table 36 presents these correlations. Relationships between the 
factors and the Moral Judgment Instrument, the Analysis of 
Argument, and the Life History Exercise, must be considered with 
the important qualification of small or partial samples. Moral 
Maturity scores were obtained on only 42 randomly selected 
students. Analysis of Argument data does not include the 1976 
Weekday College entrance cohort, and the Life History Exercise 
data was obtained for the 1977 Weekend College entrance cohort 
only. 

The relationship between the first three factors and the two 
cognitive-developmental indices in Table 36 conforms fairly well 
to the interpretations of these fac to rs presented above. The 
positive correlation of the Moral Judgment Instrument with the 
fifth factor/^ = .2l) seems inconsistent, but may be due to the 
small number of cases involved. The equally positive 
correlations of Autonomous and Assertive Stages of Adaptation 
with the fourth and fifth factors lend some credtnae to the idea 
that these two factors represent two faces of assertiveness , one 
associated with Self-Definition and largely independent of 
cognitive development (in the 'range of this population) and the 
other a by-product of *' doing," that is unrelated to 
cognitive- developmental pa t tern. 
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Table 36. 

Relations Between Entrance Factors and indices 
ExcluciGd from Factor Analysis 



Factor 



Measure 


1 


2 


3 


4 


5 


6 


Moral Judgment Instrument 


.13 


.23 


.20 


-.11 


. 21 


-. 27 


Defining Issues Test 


■ 33 


. 31 


.23 


-.08 


-.01 


-.17 


Picture Story Exercise 
Stages of Adaptation 
Recept ive 
Autonomous 
Assertive 
Integrative 


. 07 
. 07 
-.06 
.07 


.07 
. 06 
-.11 
.11 


.06 

. 11 

.13 
.04 


.09 

. i D 

.23 
.11 


-.09 
. lb 
.20 

-.10 


.15 

— . 1 J 

-.13 
-.04 


Learning Style Inventory 
Concrete Experience 
Reflective Observation 

Active Experimentation 


-. 09 
. 02 
. 20 

14 


.•12 
.01 
. 05 

-.12 


.13 
.05 
-.09 
-.17 


-.13 
-.05 
.14 
.01 


.02 
-.43 
-.12 

.47 


-.01 
.04 
.02 
.05 


Analysis of Argument 
Attack 
Defense 


.15 
-.04 


.08 
-. 13 


.09 
.03 


.04 
-.09 


-.08 
.13 


-.04 
.05 


Life History Exercise 
Per f oriiiance 
Improvement 


.24 
.16 


.16 

-.12 


-.11 
.05 


-.17 
-.03 


.05 
-.18 


-.26 
-.01 
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Summary of Factors Un derlying 
Entrance Assessments 

Briefly summarizing the factors underlying entrance 
assessments, the first three factors appear to show that all of 
the cognitive-developmental measures and the generic ability 
measures were measuring general cognitive development in part, 
but that one subset accounted for variance in soc io-emotional 
maturity unrelated to logical thought while another subset 
accounted for variance in logical thought unrelated to 
sociO'emotional maturity. The last three factors reflected 
characteristics in the population that appeared independent of, 
or negatively correlated with, cognitive development. Factor 4 
has been interpreted as reflectiag self-assertion on the basis of 
the significant positive loadings of Self-Definition and the 
Power Motive. Factor 5 was identified as a different sort of 
assertiveness because of the negative correlation with the 
general cognitive development factor. The highest loading 
variable was the Active/Reflective scale of the Learning Style 
Inventory. High scc^'es on this scale indicate preference for 
Active Experimentation over Reflective Observation. Factor 6 was 
strongly identified with Affiliation Motive scores^ and the 
factor was negatively correlated with the logical thought factor 
underlying the critical thinking measures and several of the 
cognitive-developmental measures. 



Change in t:hG Fac tors 

With this minimal framework of the relationships between 
measures and what they might be measuring^ we examined changes 
across the three assessments in two ways. Factor-analytic 
solutions identical to those reported above for entrance 
assessments were conducted on second and third assessments. 



Seco nd A L;i;essment: Factors 

Table 37 .presents the factor pattern matrix, factor 
structure, and factor correlations for the second assessment 
outcomes. 

At second assessment, two years after entrance^ the factor 
pattern hears a significant resemblance to the factor pattern of 
entrance assessments, but there are some noteworthy differenoes. 
It must of course be borne in mind that several things could have 
affected these changes besides actual change in the population 
(e.g., effects of retesting). 

The first factor at second assessment shows a slightly 
different clustering of three indices of the Critical Thinking 
Appraisal cluster with the Test of Cognitive Development and the 
Defining Issues Test. The second factor appears to be new. 
Table 37 shows that it is uncorrelated with the first factor, and 
negatively correlated with the third factor. The third factor is 
substantially the same as the third factor in Table 35 for 



Table 37. 

Ob liquid Factor Soluiion for El^bt Measures 
ar. Second Assessment 





Pattern Matrix 
Factor 


Structure Matrix 
Factor 


Measure 
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Measures of Vocational, Educa- 


























tional and Personal Issues 


























"Rest Class" Essay 
"Decision" Essay 

" r* n T" n t > T* " !• *I A V 


. 15 
.00 


. 06 
.02 

-.13 


. 62 
.62 

^58 


-.05 
.09 


- . 14 
.15 
-.07 


- . 09 
-.10 
.17 


. 28 
.04 
.13 


02 
-.07 
-.17 


.62 

.61 - 
.59 


.01 
-.07 
.08 


.00 
.24 

.04 


-.06 
-.08 
.16 


Sentence Completion Test 


.17 


-.U 


.36 


-.13 


.09 


. 32 


.26 


11 


.45 - 


-. 11 


.18 


. 30 


DefininR Issues Test 


























P% Score 


ill 


.25 


.21 


.21 


.07 


.12 


.63 


.26 


.32 


.23 


.21 


.18 


Test of Cognitive Development 


. 35 


.14 


-.03 


-.05 


.01 


.11 


.55 


.18 


.10 


-.02 


.10 


.13 


Picture Story Exercise 


























Sel f-Def inition 


-.22 


. 03 


-.09 


. 04 


-. 26 


. M J 


- 28 


. 1 2 


-. 18 


. 02 


. 32 


.46 


Achievement Motive 
Affiliation Motive 
Power Motive 


-.04 
.05 
-.00 


.29 

-.10 


.07 
-.13 
-.09 


-.04 
-.64 
.54 


.20 
-.03 
.03 


.49 
.18 
.14 


.02 
-.03 
.01 


.38 
.04 
-.09 


.07 
-.10 
-.09 


-.04 
-.63 - 
.55" 


.19 
-.08 
.04 


,54 
.16 
.13 


Learning Style Inventory 


























Abstract /Concrete 

Learning Orientation 


.12 




-.07 


.09 


-.01 


.11 


.12 


.34 


-.08 


.09 - 


-.00 


.16 


Act ive/ Reflective 

Learning Orientation 


-.01 


-.05 


-.06 


.06 


.62 


.01 


.09 


-.05 


.05 


.09 


.61 


-.01 


Test of Thematic Analysis 


.07 


-.36 


.01 


. 11 


.04 


.04 


.07 


-.36 


.07 


.13 


.07 


-.03 


Critical Thinking Appraisal 


























Inf erence 
Recognlt ion 


. ^3 
'.58 


-.02 
-.12 


.11 

.02 


-.02 
-.09 


,21 
-.05 


-.09 
-.03 


.59 
.37 


-.04 
-.10 


.27 
.17 


.02 
-.05 


.32 
.05 


-.09 
-.05 


Deduct ion 


.71 


-.06 


-.08 


.07 


-.05 


-.15 


.69 


-.06 


.09 


.11 


.07 


- 16 



Factor Correlation 
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.25 


-.12 








Factor 


4 


.07 


-.04 


-.03 






Factor 


5 


. 17 


-.01 


.18 


.05 




Factor 


6 ' 


.00 


.19 


.03 


.02 


. -.01 
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entrance assessments. The fourth factor in second assessments is 
most strongly identified by inversely related Power and 
Affiliation Motive scores, while Self-Definition clusters with 
Achievement Motive scores on Factor 6. Factor 5 remains 
identified mainly with the Active/Reflective dimension of the 
Learning Style Inventory. 

The factor structure for second assessments confirms that the 
first factor is largely unchanged from first assessment, and that 
the second factor is not as new as it appeared ir. the pattern 
matrix. The shifts in loadings between the first two factors 
-.nvolve the Concrete-Abstract learning style orientation, the 
Test of Thematic Analysis, and the three submeasures of tlie 
Watsovi-Glaser Critical Thinking Appraisal. 



Third Ass e s sme n t F a c t o r s 

Factoring of the third assessments produced one less factor 
under the criterion of contributing more than a single unit of 
variance. Again, in Table 38, we see the same measures loading 
on the first factor at third assessment. The second factor is 
the same as the fourth second assessment factor: a high 
Power/low Affiliation motive factor. The third factor is defined 
by the achievement motive score, and this appears to be something 
new vis-a-vis entrance and second assessments. The fourth factor 
shows only high negative loadings, on Best Class and Decision 
essays of the Measure of Vocational, Educational and Personal 
Issues, and the Abstrac t/Concrete orientation of the Leai*ning 
Style Inventory. The fifth, and in this case last, factor 
appears to be like the third factor in the previous two 
assessments (i.e., the socio-emotional maturity factor). 

Sec(Mul-()rder Fac tors 

Examination of second-order factors provides a means of 
getting beyond the fluctuations between variances specific to 
individual measures. Three second-order factors emerged from 
both first and second assessments, as shown in Tables 39 and 40. 
The first second-order factor for both assessments was most 
closely associated with the first primary factor, as would be 
expected. For the first or entrance assessment, however , the 
first second-order factor also shows moderately strong loadings 
for the second and fifth first-order factors. This effectively 
decides the case for the first factor in favor of the logical 
thought or critical thinking component. The socio-emotional 
maturity factor remains separate in the thi rd se cond- order 
factor. The middle second-order factor is distinguished by the 
high loading for' the sixth . primary factor, which was itself 
distinguished by the affiliation motive variable. 

Second assesaiientjsecond-order factors were more clearly like 
the first assesaraa^rt second-order factors. The most noticeable 
contrast between entrance ' second-order factors and second 
second-order factors is the opposite si^n of the loading for 
Active/Reflective Learning Style orientation on first 
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Table 38. 



Ob 1.1 que Fn.:tur Soiuti 

at Third Xs^nmantirM 



uti tor Uip.ht Measurctt 



Measure 



Measures of Vocational, Educa- 
tional and Personal Issues 

"Best Class" Essay 
"Decision" Essay 
••Career" Essay 

Sentence Completion Test 

DefininR Issues Test 

P% Score 
Test of Cof^nitive Development 
Picture Story Exercise 

Self-Definition 

Achievement Motive 
Affi nation Motive 
Power Motive 

Learning Style Inventory 

Abstract/Concrete 

Learning Orientation 

Active/Reflective 

Learning Orientation 

Test of Thematic Analysis 

Critical Thinking Appraisal 

Inference 
Recognlt ion 
Deduct ion 



.60 



Pattern Matrix 
Factor 



02 


-. 11 


■ . 


-.U2 


.21 


08 




.03 


-.56 


.20 


09 


.06 


-.06 


-.01 


.79 


25 


-. n^} 


.07 


-.OS 


.!*2 



.13 
.09 



.lA 

;03 



-.05 
-.00 



•Jl 
.03 



.09 


-.19 


.20 


.06 


.05 


.02 


-.03 


.75 


-.18 


.08 


.OA 


-.30 


.03 


.17 


-.02 


.01 


.67 


.07 


.19 


.07 


.03 


.02 


.11 




-.09 


.00 


.12 


.18 


-.01 


-.08 


.2A 


-.04 


.OA 


-.01 


.20 




-.02 


.GA 


-.09 


-.06 




- . OA 


-.06 


-.07 


.02 




-.02 


-.06 


. 10 


-.07 



Structure Mirrir; 
Ficcor 



,2A 


-.12 


-.36 


-.A7 


. 3A 


.3A 


.08 


.01 


-.6A 


.35 


.20 


-.06 


-.08 


-.17 


.75 


.AO 


-.05 


.03 


-. 23 


.52 


.AS 


.16 


.11 


-. 2A 


.A2 


.63 


.18 


-.07 


-.21 


.23 


-.lA 


-.20 • 


.19 


.10 


. 02 



.01 

.11 

.08 



.01 
.51 
.65 



. 7A 
.00 
.12 



. 18 
.21 
.10 



.61 .10 
.56 .OA 
.72 . 10 



.00 -.27 
.11 -.25 
.11 -.13 



.09 
.02 
.06 



. lA 


.09 


. J»0 


-.AA 


.02 


-.02 




.19 


-.00 


-.10 


.30 


-.02 


.01 


-.13 


.29 



.17 
.23 
.18 



Factor Correlation 







1 


2 . 


3 


A 


Factor 


1 










Factor 


2 


.16 








Factor 


3 


-.07 


.08 






Factor 


A 


-.32 


-. 10 


.01 




Factor 


5 


.35 


-. 13 


-.OA 


-.23 
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Pat turn Matrix 




Structure Matrix 


HP 1. 






Fac tor 








Factor _ 








1 




_i 




' 'l 


2" 






















Factor 


I 


.89 


.OA 


.20 




.90 


-.08 


.28 


Factor 


2 






-.10 




.50 


-.33 


-.10 


Fac tor 


3 


A2 


-.13 


.86 






-.02 


.85 


Factor 


A 


. 10 


-.11 


-';06 




. 12 


-.13 


-.06 


Fac tor 


5 


-.55 


-.18 


-.07 




-.52 


-.09 


-".lA 


Factor 


6 


.11. 


.80 


-.13 




-.OA 


.76 


.01 



L 



Fac tor Co r re la l lo ns 
"^T 2 



Factor 1 
Factor 2 
Factor 3 



-.17 
.08 



.15 



137 



163 



ERIC 



Tab!.- ^0. 

Second-order Oblique Factor Solution for Six Factors 
from Second Assessment 



t 








Pattern Matrix 


• 


Structure Matrix 


HP 2 






Factor 






Factor 








1 


2 


3 


I 


2 


3 


Factor 


1 


.kl 


.04 


17 


.51 


.04 


.27 


Factor 


2 


.02 


.98 


]0 


-.01 


.98 


-.07 


Factor 


3 


.06 


. -.05 1. 


07 


.28 


-.02 


1.08 


Factor 


4 


.22 


-.02 


07' 


.20 


-.02 


-.03 


Factor 


5 


.45 


.01 


11 


.47 


.01 


.20 


Factor 


6 


-.of 


.43 


02 


-.01 

i — — — — - 


.43 


.03 



Factor Correlations 



1 2 3 



Factor 1 

Factor 2 -.01 
Faccor 3 .21 .03 
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second-order factors. Hecalling the dramatic changes in learning 
style preferences recorded through the first interval, it stands 
to reason that part of what is manifest here is simply an 
alignment between preference and performance. 

The "^hird second-order factor for second -r- 3essment, as with 
entrance assessment, represents the socio-emotional maturity 
factor. The middle second-order factor for second assessment 
defies simple interpretation, since its highest loading is one of 
the more obscure primary factors from second assessment. 
Inspection of the simple correlations between second-order 
factors and raw variables revealed the strongest correlation to 
be with the achievement motive variable. It is worth mention 
that in both entrance and second assesSiTients, the non-cognitive 
factor appears to be definea by a motivation variable, 
affiliation for entranoa assessments and achievement for- second 
assessment . 

Only two second-order factors appeared for third assessment 
from the original five factors. Table 41 shows that the two 
cognitive factors, interpreted as logical thought and 
socio-emotional maturi ty , load together on tlie f i rs t second- order 
factor. The second factor is distinguished by the high loadin^^ 
of the second primary factor, which, interestingly, waa 
identified with the power motive. 

Summary of I*\actor Comparisonn 

The series of factor analyses included the same set of 
measures obtained from the same students on three occasions. 
This constancy is the basis for speculation that the reduction 
f'rom six to five primary factors, and three to two second-order 
factors at third assessment, may signal integration of logical 
thought and socio-emotional maturity. Certainly alternative 
hypotheses abound, for instance the phenomenon, if not simply 
meaningless, may be explained by retest effects. In any case, as 
the goal here is more one of theory building rather than theory 
verification, the speculation suggests many .specific tests of 
conf innatlon or diaconfinnatlon in further analyses of the data. 
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Table Al. 



Second-ortler Obli(|ue Factor Solution for Five Factors 
from Third Assessment 



HP 1 



Factor 1 
Factor 2 
Factor 3 
Factor 4 
Factor 5 



Pattern Matrix 

Fa ctor 

" ' 1 2' 



.75 
,13 
,05 
■ 62 
.59 



-.01 

A3. 
.20 

-.16 

-.20 



Structure Matrix 

Fac tor 

1 2 



■Jl 
,08 

.06 

.61 

.60 



-.06 
.67 
.20 
-.12 
-.24 



Factor Correlations 



FpcLor 1 

Factor 2 -.0 7 



1 

i 
\ 



i 
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DISCUSSION 



This study demonstrates a set of assumptions and values 
concerning college responsibilities for the nature and function 
of liberal education. It also sets forth assumptions, valueti and 
objectives for research and evaluation in higher education. 

This study is part of a broader program validation effort 
designed to investigate how a college program contributes to 
student learning and development. It pursues the links between 
abilities developed in college and latter career and personal 
performance (Mentkowski and Doherty, 1933). It ar*gue. for 
institutional accountability for the traditional promises of 
liberal arts education, namely life-long learning and 
development, and transfer of learning and abilities across 
different roles and settings. 

We matched research questions to explicit goals and 
objectives of the institution, worked collaboratively with 
faculty across disciplines, and devised methods to involve 
students to insure represeiitative participr^tion. We linked 
external criterion measures not only to goals, but to principles 
of assessment broadly recognized and shared by faculty in 
assessing all kinds of student perfomiance. 

Putting these several commitmentw^ into action required going 
beyond conventional procedures and forms of instrumentation 
employed in most earlier studies of college outcomes. The 
measures used in this study vary considerably in character and 
length of use, and most are still experimental in application to 
measurement of college o^'**comes. 

McBer's Cognitive Competence Assessment Battery vWint^r, 
McClelland Stewart, 1981 ), for example, is partly ^ unded on 

assessment techniques (e.g., TAT) in uee for many years. 
Similarly, some cognf tive-developmental schemes and instruments 
have long histories of development and re finement (Colby, 1978; 
Rest, 1981), while others are virtually brand new (Mentkowski, 
Moeser Strait, 1983). Yet none of those instruments has much 

o':' a history as a college outcomes measure. An Important outcome 
of this study is the record of performance of these instruments 
in a higher education setting; a record of mutual benefit to 
educators 9nd educational researchers. 

These questions detemined the data analyses: 

• Can change be measured with this battery of 
cognitive-developmental and generic ability 
instruments? 

• Can chanf^o be attributed to a college learning 
process while controlling^ for other renrionable 
effects? 



HI 



• Do relationships among outcomes suggest any 
underlying abilities and processes that could 
serve to explicate those abilities that should be 
the focus for higher education and do tnese 
relationships illumine means of student 

development aod assessment? 

These data analyses provide a base for the more specialized 
analyses we plan in future papers that will "more directly 
contribute to adult learning and developnent theory, and to 
improving teaching and learning practice. 

In response to the three stated questions, we found ample 
evidence that the selected measures could record change, and some 
evidence that degrees of time and performance in the .earning 
process made a difference in the changes that occurred. Given 
the size and number of background and program differences 
controlled in the causal analysis, finding some relationship 
remaining between change and time and performance was quite 
remarkable. 

We found several patterns in the data which serve as starting 
points for the more in-depth interpretation of the results that 
will follow this broad, initial look. They are discussed below. 



Pa tterns 



Does Change Occur? 



C o gnitive-Developmental Measures 
Showed More Change Than Generic 
Ability Measures 

In both cross-sectional and longitudinal studies, there were 
more instances of significant differences between groups or more 
significant change over time, respectively, on measures designed 
to test aspects of general cognitive developnent than on measures 
testing generic abilities — particularly analytic ability. 

Both studies indicated growth as measured on Perry s Scheme 
of Intellectual and Ethical Development and as measured by Rest s 
objective test of moral 'developnent (following Kohlberg;. 
Differences were found betveen freshmen and seniors in the 
cross-sectional study of Loevinger'o ego developnent stages, and 
Kohlber^'s moral maturity scale; the longitudinal study revealed 
improvement over time on, the Piagetian-based test of formal 
operations (Test of Cognitive Development). 

The scope of this paper does not permit detailed scrutiny ot 
the many points particular to the form and special purposes of 
each measure. It is important to note, however, that these 
measures are not used here aa inter<.hnnfieable indicators of a 
unidimenaionaT~phenomenon cabled cognitive developnent. Tho main 
support for change is not the quantitative fact that change waa 
recorded in a majority of attempts. On the contrary, it is 
important to observe which instruments show wha_t change in 
relation to their respective purposoc and interrelationships. 
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For example, suppose the results we obtained with the Perry 
measure and the results we obtained with Loevinger's measure were 
reversed. Results showing more change on the ego development 
measure than on the Perry measure would lead us to , suspect a 
measurement problem rather than support for student change. The 
Perry scheme was created to represent a series of developmental 
positions traversed by students during the college years. 
Loevinger's levels of ego development are meant to represent 
milestones of a broader psychosocial development across 
adolescence and adulthood. 

Perry's scheme was instrumented wi hh essay questions that tap 
related, but relatively narrow, st rands of intellectual and ethical 
development. For example, the Best Class essay dealt with 
evolving epistemological sophistication. The scope of change 
recorded was narrow, and it was the kind of change the learning 
process is designed to evoke. The ego development measure deals 
with many strands of development at once, compressed into a 
composite estimate of level of core functioning. The 
epistemological changes recorded on the Best Class essay could be 
reflected in parts of the ego developjnent measure, but the 
composite estimate of core functioning may not change if there is 
not comparable aff-^ctive and interpersonal development. Change 
on the ego development measure like that recorded with the Perry 
measure would not bg^ consistent with the concepts which guided 
construction of the measure. 

This one example suggests the kind and level of detail which 
is necessary to fully explicate the findings. For now it must 
suffice to say that the patterns of change among the 
cognitive-developmental measures were not at odds with our 
expectations. 

In contrast, three measures ox* analytic ability provided 
fewer indications of difference or change. There were 
improvements on the Wa tson-Glaser Critical Thinking Appra^'sal for 
the students in the longitudinal study of persisters in the 
program who participated in all three assessments. But the Tes 
of Thematic Analysis and the Analysis of Argument measures showed 
very little variance between groups or across .time. This does 
not mean that students did not improve in generic abilities other 
than analysis, since analysis was the only generic ability really 
assessed by the external criterion measures. Whether or not they 
improved in other aspects of analysis, or whether the instruint^nts 
successfully captured change or its absence for some students, is 
a subject for more detailed analysis. 

It is interesting to note that the pattern of change recorded 
among the cognitive-developmental measures suggested there was 
more change or growth in logical thought, or intellectual 
development, than in soc io-emotional developnent. It was those 
measures defining the logical thought factor, especially the 
Defining Issues Test and the Test of Cognitive Development, which 
showed the most change between intervals in the longitudinal 
study. The Perry and Loevinger measures, more closely identified 
with tVe socio-emotional maturity factor, did not show as much 
change overall. Why was this pattern not echoed or supported by 
the analysis measures? 



While unreliability is one possibility, especially with the 
new measures of analysis, another possibility is that the 
analysis measures were more difficult tasks. To the extent that 
'the underlying capability manifest as intellectual developnent is 
the same capability required to perform analytic tasks, the 
results may simply reveal that the analysis measures involved a 
higher order of complexity than did the cognitive-developmental 
measures. The change registered on the developnental measures 
was from a low to moderate level of complexity, while the 
analysis measures showing no change demanded a still higher level 
to discriminate between performances. 

Begi nn ing Students' Performance 
Cognitive-Developmenta"l~"Measures 
Was Rela ted to Age; Performance 
o n Ability Measures Was Related 
la High School Grades 

Nearly all measures showed some correlation with age, but the 
association of age with measures designed to test cognitive 
development were much stronger. This was an expected finding, 
and serves to confirm that measures were doing what they were 
supposed to do. The Sentence Completion Test of Ego Development 
provides a counterpoint in not being correlated with age; this 
was expected because this measure and theoiy were explicitly 
designed to be as independent of age as possible. 

The Watson-Glaser Critical Thinking Appraisal was not related 
to age, but was related to high school grades, ai> index of 
academic ability, also an expected finding. The Test of 
Cognitive Development was also related to grade point averafeo 
rather than age, which we did not expect. This suggests that 
this latter measure may be more sensitive to academic skills than 
would be desirable for a test of cognitive development, and that 
it may be operating more as another analysis ability measure. 

On the other hand, the Test of Cognitive Development is 
unlike the other cognitive-developmental measures in that it does 
not assess a spectrum of positions or a sequence of stages; 
rather, it assesses "how much" evidence is present indicative of 
the use of formal operations in a student's work. This means 
that the n.casure's apparent fi.nction as a ski U . neasure does not 
necessarily contradict its conceptual base as a developnental 
measure; it does highlight the issue that "a developmental 
measure" and "a measure of development" may not mean the same 
thing. 



There Wa s More Change un 
^e"coglrrition-Type Measure_3 

Meaourfis 

Rest's Defining Issues Test 
Inventory presented unambiguous 



and Kolb's Learning Style 
evidence of difference and 
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change. Changes on the Defining Issues Test show significant 
increments in principled moral reasoning for both the first and 
the second two years of college, although change is more dramatic 
the first two years. Changes on the Learning Style Inventory 
involved significant decrements in preferences for Concrete 
Experience and Reflective Obsarvation, and significant increments 
in preference for Abstract Conceptualization. There was no 
change in preference for Active Experimentation. These changes 
occurred in the first two years, and the net result was a more 
balanced set of aggregate preferences at second -assessment than 
was true for first assessment. 

What these measures share, i.iore than intended constructs, is 
the incidental characteristic of being recognition- type rather 
than produc tion-type tests. The general strength of recognition 
test results over production test results is hardly surprising. 
These tests require less effort to take, and changes in awareness 
are known to precede changes in being able to generate one' s own 
form of an ability. The phenomenon reminds us to look closely at 
this attribute of the measures in weighing the magnitude of 
results as part of our interpretation of the substantive changes 
indicated. It is our expectation, based on past research 
(McClelland, 19B0), that the comparatively cmaller indications of 
change on production measures will loom larger in relation to 
long-term effects concerning careering or future learning. 



Wha t Ca us e s Ch a ng e? 

Age A c counts fo r Dif fere nce 
ami Chang e i n Coll ege 

Age, a variable which partially stands in for many, important 
life influences or experiences, accounts for change during 
college. This is expected because of the broai age range tapped 
in this study of both traditional and non-traditional age 
s^tudents. When looking for effects of college experience or 
performance on broad cognitive-developmental and generic 
abilities, we are reminded to look for increments of change in 
relation to hypothesized global and forceful life experiences 
younger and older people undergo before, during, and after 
college, for wliich age is a partial indicator. 

This shows how critical it is that college programs build on 
and anticipate student experience outside the classroom. New 
learning must be relevant to old learning. It is a critical link 
that assists students to see the value of liberal arts learning 
goals as well as career goals (Much & Mentkowski, 19B2). We 
suggest that future research direct attention to identifying the 
kinds of experiences that lead to chcinge in performance in 
cognitive-developmental and generic abilitie^s. 
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students Change More in the First 
Two Years, But l?maller Amounts of 
Change in the Last Period Are More 
Closely Related to College 
Performance 

Most of the relatively dramatic changes over tiiiie in our 
longitudinal study occurred during the first two year period. 
These changes during the first period were not replicated in the 
second year and one half period. 

However, in the, causal analysis of these changes, af'er 
controlling for all other measured contributing factors (pre-test 
score, and background and program covariates) , there were 
actually more instances in the second interval where college 
performance variables accounted for additional variance in 
post-test scores. 

These results suggest that the many changes in life 
circumstances brought on by or accompanying going to college have 
a greater impact on student development than does the level of 
performance in college during the. first two years. After life 
adjustments have been made, and related growth has occurred, 
further developnent may be more dependent on college performance 
during the later period. Then the student begins to specialize 
in a major, and may extend earlier gains to nisw content areas, 
and focus on discipline-related goals not tapped by broad outcome 
measures. One general statement wo can make about change as a 
function of college performance in the second interval is that 
change is dependent on college performance in the first interval. 
Some relationships between change in the second interval and' 
performance in the second interval indicate that students who did 
not achieve a lot in the first two years suffered negative 
changes during the second two years. 



Beginning Students* Performance on 
the Ex t ernal Criterion Measur es 
In vol^' ^ Two Majo r Factors , 
Intellectual Ability and 
Socio-Emotional Maturity. The 
Two Factors W ere Integrated b y 
the End of Co llege . 

Factor analyses of results of first and second assesanenta 
were conducted to derive first and second-border factors. Based 
on correlations with first-order factors and raw variables, the 
second-order factors from both assesi^nents reflect two dimensions 
of cognitive developnent: intellectual ability and 

socio-emotional maturity. In the final assessment analysis, a 
single second-order factor appeared in place of the two found on 
first and second assessments. Our interpretation is that theae 
dimensions of development mignt actually mor^e into a sin^^le 
integrated or harmonious factor durinf^ collude. (This Is not 



What Relationships Among Abilities Emerge? 




attributable to pe rfo-Tnance variables over others in the present 
form of the analysir,.) 

Taking into account the patterns of results on individual 
measures as well as the intercorrelations among measures, it is 
our judgment that this integration of factors probably occurs in 
the Alverno population through intellectual development "catching 
up" as it were, to soc io-emotional maturity. To the extent this 
may accurately reflect the general case, what implications might 
it have for designing liberal education curricula for the 
non-traditional student? We will have more to say about this 
issue as we probe the differences in our data between traditional 
and older students. 

This finding argues for careful attention by educators to 
develop ways to stimulate integration of these abilities, rather 
than to foster their separation by exclusive attention to one or 
the other. 



Implications 

The first implication is that the results are promising and 
suggest further interpretation and analysis. These findings 
barely scratch the surface of the data. The results reported in 
this paper served the primary purpose of confirmation of student 
change and development on external criterion measures, as part of 
a much broader program validation design. The potential use of 
the database for purposes of curriculum development and 
contribution to * theory and research in adult learning and 
development has yet to be exploited. Results so far -iuggest 
further investment in this dataluiso toward that goal. 

The issues related to curriculum development which could 
benefit from further analysis of the database are literally 
without number. One area of specific application already beguu 
at Alverno is the use of data from essays rated according to 
Perry's scheme of development in communications assessinent and 
instruction. The most frequently cited criteria used in rating 
essays at a range of positions are being tested in the classroom 
as stimuli to increase student awareness of the range of 
perspectives they and others may employ. The Learning Style 
Inventory is used in the New Student Seminar to prompt discussion 
of various learning styles. These are two brief examples of the 
immediate utility being derived from a more detailed level of 
analysis on a single measure. 

Fur nt)W, wi- iuivc siiown Lhat the Ic^arniii).; p rot: ess, tlir{>ii^.^li a 
y;ross per fonnaacf mocisiiru, coiU ril)ut;L'.s to r.liarijL^o. in suokin):^ to 
relate measured cliauge to tlie Alverno ] earn i,n)L', process on! 
cumulative indices of student performance in college were used. 
While none of the external measures employed coui.d serve as exact 
validation measu res for the competences de f ined by Alverno f acul- 
ty, tlio re lat ionsli i ])s betweea specific measures and performance 
in specif ic sul)ject matter areas and spec, if i c competences areas 
will provide valuable ir formation about l)otli the curriculum anti 
the external measures. i-or example, can performance in natural 
science coursework and performance in luimanities courseworlc 
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predict change in measures of analysis ability, or conversely, 
are different levels of analysis ability determinative of 
performance patterns in these areas? The present study did not 
ask if change in analysis on the external criterion measures was 
related specifically to performance on levels of the analysis 
competence as defined by Alverno faculty (Alverno, in press). 
There are relationship^ to be explored here as well. Future 
studies intended to contribute to curriculiira development must of 
course occur at the behest of faculty responsible for curricular 
change, as they are ready and able to modify programs. And the 
relationships grounded in this database can stimulate faculty 
involvement in particular problems that' need attention. 

In the course of presenting measures and aggregate results, 
we have alr^^ady indicated ways in which the present study is 
contributing to theory and research practice. Several of the 
measures we used are in different phases of development or 
refinement based on the results of our study. Most notably, the 
Perry measure, now called the Measure of Intellectual Development 
(Mines, 1982; Moore, 1982), Kolb's Adaptive Style Inventory, and 
several of the indices of McBer's Cognitive Competence Assessment 
battery, have been validated partly on the Alverno data. 

As with the issues pertaining to curriculum development, the 
possible areas for further analysis contributing to adult 
learning and development are limitless. Many indepth comparisons 
of specific results are suggested by the supporting theories. 
For example, are the perspectives of dualism, multiplicity and 
relativism describing different stages in the Perry scheme 
actuc^lly manifest in other production instruments? To the extent 
they are, does this help validate either instrument, or more 
importantly, do they show different areas of common underlying 
patterns of student thought and change? 

Many explicit conceptual links have been drawn by the 
instrument designers and theorists themselves concerning the 
relationships between measures included in our study. For 
example. Winter et al, (l98l) describes the intellectual 
flexibility they wish to assess with the Analysis of Argument 
instrument in terras of the Perry scheme's notion of developing 
relativism. Is this conceptual link supported? 

In many cases, the results themselves have pointed to 
interesting questions, as indicated above in the summary of some 
major findings. But specific questions of importance have arisen 
as well as general ideas of trends and patterns worth future 
research effort. One instance is the relationship between the 
academic achievement index, high school grade, and the Test of 
Cognitive Development score. What sense can be made of this in 
tenas of the relative importance age and ability might be 
suspected of playing in relation to cognitive development? 

Relationships among the broader cogni tive-developrriental 
measures, particularly those based on ego and moral developnent, 
have been reported in many other studies. But there have been 
few opportunities to examine multiple measures over several 
occasions of repeated measurement. Our study of change in future 
research reports will focus on relationships between change on 
one or more measures to change on other measures. The range of 
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age represented in our study will be particularly illuminating in 

this regard. ^ 

Relationships of tiie more . developoaental measures to the 
ability and style measures are equally intriguing for most 
educator^. We will investigate the stable and transi tional 
states of cognitive development in relation to learning style 
changes and improvement in analytic and human relations 
abilities. 

As these few questions and examples attest, our study of 
change in a specific college population over a specific period of 
time may be completed, but our study of change in every other 
respect has jiist begun. We have confirmed that change in 
cognitive developoient and other characteristics important 1?^ 
learning can be successfully recorded, that relationships between 
student change and student performance at this level can be 
studied. We have seen the possibility, in the factor analyses, 
that change at the broadest level may be towards balance an' 
integration rather than some linear upward mo^^ nn^^nt. Ii 
following studies, we will explore the detailed implications of 
these findings which we think will have more direct implications 
for practice. 



SUMMARY 



This study describes changes in abilities learned in college 
and examines change as a function of a college learning process. 
It also explores relationships and patterns among these 
abilities. The measures used are, for the most part, newly 
developed and new to use as college outcomes measures. 

Results showed change on most meaiures, and controlled for a 
range of background and program differences. Causal analyses 
linked some changes to performance in the college learning 
process. There is some evidence that students demonstrate two 
dimensions of cognitive developoaent , intellectual ability and 
socio-emotional maturity on entry to college and that these-are 
integrated by graduation. 

Future interpretations of results specific to the several 
instruments and their interrelationships will more directly 
contribute to our understanding of the developnent of abilities 
learned in college. " Implications for practice are that change is 
measurable and that the broad outcomes of higher education can 
be specified and assessed. 
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APPENDIX I 



Table A 

Data Summary for t Tests of Mean Differences at Entrance 
Between Students Included and Mot Included 



Included 



Not Included 



SD 



SD 



df 



Measure of 


oeSL LiluBci C/oUay 




1 
J 




1 


. 1 J 


364 


3 


. 02 


1 


. 1 6 


558 


0. .'j3 


Vocatio'- il . 




























Educational , 


"Decision" Essay " 


197 . 


3 


.26 


1 


.11 


361 


3 


. 36 


\ 


.10 




-0.96 


and Personal 






























Licit ttt^r r-3o«y 


180 


J 








1 

J 4 i 


3 


. 02 


I 


.23 


519 


~0.I1 


Sentence 




























Completion 




199 


5 


.41 


0 


.79 


476 


5 


. 32 


0, 


.98 


457.2 


1.16^ 






























hk>ral Judgment 




























Instrument 








.40 


30, 


.81 


30 


337, 


. 70 


37, 


.00 


70 


1 . 21 


Def Inlng 


VX Score 




38, 


.'A 


13. 


, 39 


376 


40. 


,07 


13. 


, 79 


548 


-1.25 


T s sues 




























Test 


D Score 


17A 




,r8 


6. 


,87 


175 


25. 


,64 


6. 


,48 


54 7 


-1. 59 


Test of 




























Cognit ive 




191 


11. 


,45 


3. 


38 


484 


10. 


75 


3. 


80 


673 


2.23* 


Development 


























Picture 


Stages of Adaptation 


























Story 


Receptive 


199 


2. 


86 


1. 


87''l 


478 


2. 


48 


1. 


61 


325.6 


2. 53* 


Exerc Ise 


Autonomous 


199 


2. 


14 


1. 


56 


478 


2 , 


15 


1 . 


49 


675 


-0.10 




Asae :t ive 


199 


0. 


80 


1^ ^ 


01 


4 78 


0. 


72 


- 0. 


92 


675 


1.00 




Integrative 


199 


3. 


86 


1. 


99 


4 78 


3. 


49 


1. 


95 


675 


2.26* 




Self-Definition 


199 


-2. 


14 


3. 


45 


478 


-2 . 


58 


3. 


80 


675 


1.42 



ERIC 





Achievement Motive 


199 


6. 


,21 


5, 


.17 


4 78 


6. 


,96 


5. 


,08 


675 


-1, 


. 76 




Affiliation Motive 


199 


7. 


,14 


3, 


.46 


4 78 


7, 


.03 


3. 


,61 


675 


0. 


,37 




Power Motive 


199 


6. 


,24 


/, , 


.20 


478 


5. 


,94 


3. 


, 55 


321.8 


0. 


,90 


Learning 


Concrete Experience 


202 


15. 


9 7 


2. 


, 79 


4 78 


16. 


,00 


2. 


,97 


678 


-0. 


,12 


Style 


Reflective Observation 


202 


15. 


,04 


3, 


, 32 


4 78 


14. 


,56 


3. 


,51 


678 


1. 


,66 


Inventory 


Abstract Conceptualizat io " 


202 


14. 


99 


3. 


33 


478 


15. 


,44 


3. 


,31 


678 


-1. 


,61 




Active Experimentation 


202 


15. 


,49 


2. 


,64 


478 


15. 


,58 


2. 


, 74 


678 


-0. 


,40 



Adaptive 
Style 
Inventory 



Test of 
Thematic 
Analysis 

Analysis 
of 

Argument 

Critical 
Thinking 
Appraisal 



Life 
History 
Exercise 



Abstract /Concrete 
Learning Orientation 21)^ 

Act ive/ Reflect ive 
Learning Orientation 202 



Total Concrete Experlenee NA 
Total Reflective Observation a NA: 



Total .\b:?tract Conceptualizat Ton NA^ 
Total Active Experimentation 



Abstract/ Concrete 
Adaptive Orientation 

Act Ive/ Re fleet ive 
Adaptive Orientation 



At*:ack 

Defense 

Inference 

Recognition 

Deduction 



NA 



Performance 
IaproveiA*int 

4 

''Separate Variance ^stloiate used. 
•J 

"Not Applicable- Students were not 
given this measure at time of 
first assessment. 



-0.98 



0.4'') 



5.01 



J. 18 



478 



478 



-0.56 



1.01 



5.29 678 



5.34 678 



-0.96 



-1.27 



194 


1. 


,4J 


1. 


16 


410 


1. 


,10 


1, 


.24 


602 


2.94*^ 


133^ 


-0. 


,63 


1. 


48 


249-^ 


-0. 


, -^5 


1. 


,61 


380 


-0.48 


134^ 


-1. 


,7/ 


0. 


79 


251^ 


-1. 


63 


1, 


.01 


331.6 


-1. 53^ 


131 


9. 


,38 


3. 


08 


406 


9. 


,07 


3. 


,05 


585 


1.14 


181 


11. 


13 


2. 


49 


406 


IG. 


,01 


2. 


, 59 


585 


0.95 


180 


16. 


,10 


3. 


23 


404 


15. 


83 


3. 


,31 


582 


0.91 


57^ 


59. 


,09 


6. 


40 




57. 


,46 




,48 


189 


1.60 


S7^ 


7, 


.98 


23. 


,36 




5 


.54 


; 1 


.35 


189 


0. 70 



Studenra entering In 1977 only. 

4 

Weekend Students only. 

*p «: .05 
*£ ^ .01 

156 



182 



Table B 



Data Summary for JL Taets of Second AssesBtnent Differences 
Between Students Included and Not Included ^ 



Measure of 
Vocational* 
Educational, 
and Personal 
Issues 

Sentence 
Cotaplet Ion 
Test 

Moral Judgtsent 
Instrument 

Defining 
Issues 
Test 

Test of 
Cognit ive 
Developraeiit 

Picture 
Story 
Exerc Ise 



Learning 
Style 
Inventory 



Adaptive 
Style 
Inventory 



Test of 
Themat ic 
Analysis 

Analysis 
of 

Argument 

Critical 
Thinking 
Appraisal 

Life 
History 
Exercise 



••^just Class" Essay 
'Decision" Essay 
"Career" ELoay 



PZ Score 
0 Score 



Stages of Adaptation 
Receptive 
Autonomous 
Assert ive 
Integrative 

Self-Definition 

Achievement Mottve 
Affiliation Motive 
Power Motive 

Concrete Experience 
Reflective Observation 
Abstract Conceptualization 
Active Experimentation 

Abstract/Concrete 
Learning Orientation 

Active/Reflect ive 
Learning Orientation 

Total Concrete Experience 
Total Reflective Observation 
Total Abstract Conceptual Izat 
Total Active Experimentation 

Abstrsct /Concrete 
Adaptive Orientation 

Act ive/ Reflect Ive 
Adaptive Orientation 



Attack 

Defense 

Inference 

Recognition 

Deduction 

Performance 

Inprcveoent 



Included 



182 
182 
182 



^Separate Variance Eatitnate used. 



Not Included 



n 


M 






n 






df 


t 


196 


3. 


23 


1. 


23 


L35 


3.52 


l.'i6 


329 


-2.08* 


ir/ 


3. 


46 


1. 13 


134 


3.61 


1.09 


329 


-1.20 


195 


3. 


11 


1. 


15 


L35 


3.37 


L.18 


328 


-3.56*** 


199 


5. 


34 


0. 


99 


134 


5.25 


1.18 


251.4 


0.73^ 


43 


340. 


67 


43. 


80 


37 


337.68 


41.42 


78 


0.31 


176 


46.26 


13. 


97 


L17 


46.46 


13.51 


291 


-0.12 


17*:' 


27. 


56 


6. 


87 


117 


27.85 


5.47 


281 . 5 


1 

-0 . 40 


191 


12.24 


3. 


11 


139 


11.89 


3.62 


269.7 


0.93^ 


L99 


2. 


56 


L. 


66 


137 


2.61 


1 .53 


334 


0. 25 


199 


2. 


32 


1. 


55 


137 


2.42 


1.58 


334 


-0.59 


199 


1. 


11 


1. 


13 


" 137 


0.86 


1.07 


334 


1.99* 


199 


3. 


75^ 


1. 


79 


137 


4. 11 


\.81 


334 


-1 . 78 


199 


-1. 


,05 


3. 


,65 


137 


-1.53 


3.69 


334 


1. 19 


199 


5. 


69 


4. 


,29 


137 


6. 19 


4. 23 


334 


- 1 . 06 


199 


6. 


,81 


3. 


43 


137 


7.47 


3.71 


334 


-1.66 


199 


7. 


,70 


4.25 


137 


7.36 


4.15 


334 


0.73 


202 


L5, 


,19 


2 


.92 


133 


15.12 


3.01 


333 


0.22 


202 


13, 


.13 


3, 


.51 


133 


13.04 


3,40 


333 


0.24 


202 


17, 


.05 




.56 


133 


16.77 


3.53 


333 


0.73 


202 


15.48 


3 


.35 


133 


15.92 


3,03 


333 


-1.21 


202 


1 


.88 


5 


.78 


133 


1.65 


5.82 


333 


0.36 


202 


2 


.35 


6 


.11 


133 


2.88 


5.59 


333 


-0.80 


199 


8 


.28 


4 


.08 


130 


7.13 


4.07 


327 


2.4'* 


199 


14 


.21 


3.10 


130 


15.22 


2.83 


327 


-2.99*>' 


199 


15 


.08 


3 


.62 


130 


15. 39 


3. 75 


327 


-0.77 


199 


10 


.43 


3.02 


130 


10.24 


2.64 


327 


0.60 


199 


6 


.80 


7 


.07 


130 


8.26 


7.30 


327 


-1.81 


199 


-3 


.77 


5 


.29 


130 


A on 






2.11* 


194 


1 


.57 


1 


.09 


141 


1.38 


1.16 


333 


1.52 


135 


-0 


.76 


1 


.35 


198 


-0.93 


1.33 


331 


1.15 


133 


-1 


.82 


0.61 


189 


-1.83 


0.61 


320 


0.16 



9.97 
10.9CJ 
16.64 



3.06 
2.58 
3.29 



60.61 7.30 
t.92 23.22 



147 
147 
147 

137 

137 



9.93 
11.38 
17.03 

60.69 

7.19 



2.77 
2.36 
3.10 

7.75 

19.05 



327 
327 ' 
327 

329 

321.6 



0.15 
-1.74 
-1.08 

-0.10 

-0.11^ 



.05 



**j) < .01 
***£ < .001 



EKLC 



157 



1S3 



Table C 



t);ita Sumroflry for Testi 
Betvecn Students 



J of Third Asae^enient Ii ' 
Included and Not Inclu.i^ 



Included 



SD 



Not Included 



SD 



df 



Heaeurc of 
Vocnt Innal , 
Educat ional, 
and Perflonal 
Isaues 

Sc. ence 
Completion 
Test 

Koral Judgment 
Instrument 

Defining 
Xs&uee 
Teat 

Teat of 
Cognlt Ive 
Development 

Picture 
Story 
Exerc Ise 



Learning 
Style 
Inventory 



/ rapt rve 
Srvle 
Inventory 



Test of 
Thematic 
Analysis 





197 


3, 


50 


I . 


33 


28 


3. 


d6 


I. 


25 


223 


0. 


54 


"De'.;lclon'* Essay 


195 


3. 


02 


I. 


4b 


26 


3. 


04 


I. 


26 


221 


-0. 


05 


■'Career" Essay 


194 


3. 


12 


I. 


39 


28 


3. 


16 


I. 


31 


220 


-0. 


20 




200 


3. 


28 


I. 


00 


33 


5. 


39 


0. 


97 


231 


-0. 


64 




43 


353. 


02 


37. 


67 


17 


349. 


24 


41. 


60 


56 


0. 


34 


?% Score 


174 


49. 


21 


r*. 


54 


27 


46. 


23 


U. 


28 


199 


1 . 




D Score 


J 


28. 


72 


6. 


77 


2? 


26. 


60 


5 


28 


199 


I. 


40 






12. 


37 


3, 


23 


32 


11. 


26 


3. 


51 


221 


I. 


74 


Stages c;f Adaptation 




























Recept l\/e 


lis 


2. 


46 


I. 


47 


31 


2. 


58 


I. 


75 


227 


-0. 


40 


Au t ono^'Ous 


196 


2. 


4/ 


I. 


66 


31 


I. 


,87 


I. 


98 


227 


I. 


63^ 


Assertive 


196 


t). 


96 


I. 


04 


31 


I. 


; 


I. 


40 


35.3 


-1. 


39^ 


Inte^ rot Ive 


198 


3. 


13 


I . 


72 


31 


3. 


, t. J 


I. 


76 


227 


0. 


09 


Self-DeClnltlon 


199 


'I. 


26 


3. 


63 


31 


-0. 


,67 


3. 


77 


226 


-0. 


56 


Achievement Mo». ive 


199 


7. 


24 


4. 


55 


31 


6. 


OA 


6. 


02 


35.5 


0. 


36^ 


Affiliation Motive 


199 


7. 


93 


3. 


63 


31 


9. 


00 


3. 


43 


228 


-1. 


53 


Power Motive 


199 


7. 


^,1 


3 . 


9/ 


31 


7 . 


26 


4. 


56 


228 


0 . 


19 


Concrete Experience 


202 


14. 


77 


3. 


24 


27 


15. 


, 74 


3 . 


37 


22 7 


1 

- L . 


A ^ 
HJ 


Ref 1 ec tlve Obs**rvat Ion 


202 


13. 


10 


3. 


,51 


2? 


13. 


,04 


3. 


41 


227 


0. 


09 


^b8tract Conceptualization 


202 


17. 


06 


3. 


42 


7.7 


16. 


,67 


3. 


73 


227 


0. 


56 


Active Experimentation 


202 


15. 


67 


3. 


, 16 


27 


15. 


, 74 


3. 


50 


22 7 


0. 


19 


Abstract /Concrete 






















227 




14 


Lear.ilng Orientation 


202 


2. 


29 


5. 


76 


27 


0. 


.93 


6. 


44 


1. 


Act ive/Ref lect Ive 


























,04 


Learning Orientation 


2D2 


2. 


75 


5. 


,91 


27 


2. 


.70 


5. 


97 


227 


0. 


Totai ( oiicrete Experience 


199 


6. 


20 


4. 


.17 


30 


7, 


.90 


3. 


70 


227 


0. 


.37 


Total Reflective Observation 


199 


14. 


27 


2, 


,90 


30 


15. 


.10 


2. 


77 


227 


-I. 


.47 


Total Abstract Conceptualization 


199 


15. 


,14 


3. 


.52 


30 


14. 


.03 


J. 


63 


22/ 


0. 


,72 


Total Active Exver Imentatlon 


199 


10. 


,36 


2, 


.75 


30 


10, 


.37 


2. 


66 


227 


0. 


,02 


Abstract /Concrete 




























Adaptive Orientation 


199 


6. 


94 


7, 


.10 


30 


6 


,73 


6. 


70 


227 


0. 


, 15 


Act Ive/Ref lect Ive 






















227 




.9?. 


Adaptive Orientation 


199 


-3, 


,89 


4; 


{77 


30 


-4 


.73 


4. 


.21 


0. 




''5 


I, 


.46 


I 


.06 


37 


U70 


I, 


.47 


43.4 


-0 


.87^ 



ERIC 



Analysis 
of 

Argument 


Attack 


135 


-0 


:3 


I. 


.32 


93 


-I. 


00 


I, 


,20 


226 


1. 


60 


Defense 


130 


-I. 


62 


0. 


.66 


91 


-I. 


64 


0. 


,60 


216.9 


2. 


20*^ 


Critical 


Inference 


18? 


10. 


36 


3. 


,05 ' 


40 


9. 


66 


2. 


.72 


220 


I. 


31 


Thinking 


Recogaition 


'. 


11. 


57 


2. 


.68 


AC 


11. 


08 


2. 


.66 


220 


I. 


05 


Appraisal 


Deduc?' ; 


l62 


17. 


16 


3. 


.06 


40 


16. 


68 


2, 


.70 


220 


0. 


92 


Life 




191 


60. 


73 


7, 


.94 


29 


59. 


55 


7 


.66 


218 


0. 


75 


History 






























Exercise 


L^a^: v ■ ■■ 


191 


5. 


17 


21, 


.01 


29 


11. 


55 


41, 


.69 


30.2 


-0. 


61^ 



^Sep--rat« Variance Kttiuwice uted. 



.05 



158 



184 



Table D 



Data Sunimary tor Analyses of Variance Between Groups 
of Entering and Graduating Students 
In the C- ^8-8ectional Snu\ 



U U^Uay 1977 Weekday 

Gradu&ilnR Students Entering Students 









M 




SD 




M 




SD 


Measure of 


"Best Class" Essay 


58 


3 


.31 


I 


.17 


71 


3 


.20 


I 


■25 
























Educat lonal , 


"Declfilon" Essay 


57 


3.95 


1 


. 22 


72 


3 


.38 




. 33 


and Personal 
























ISflues 


"Career" Essay 


57 


3 


.53 


I 


. 36 


71 


3 


.09 


I 


. lA 


Sentence 
























Coraplet Ion 




58 


5.91 


I 


. lA . 


7 A 


5 


. 50 


0 


.78 


Test 






















Moral Judgment 
























Instrument 




19 


359 


.00 


35 


.26 


16 


338 


.88 


33, 


.35 


Defining; 


PX Score 


'j3 


49 


. 15 


lA 


. 56 


70 


J J 


. /^ 


10 , 


, 56 


Issues 










I 














Test 


D Score 


53 


27 


.07 


J 


. 7A 


70 


23, 


.87 


5 , 


, 8A 


Tt<;t of 
























Cognlt Ive 






12, 


.98 


3 


.56 


73 


12 , 


. 08 


3, 


A8 


Development 




















Picture 


Stages of Ad aptatlon 






















Story 


Recept Ive 


60 


52, 


.32 


10 


.05 


76 


5A. 


,87 


11. 


62 


Exerc ise 


Autonon>ous 


60 


50, 


.70 


U, 


.05 


76 


49. 


,05 


9. 


75 




IL o c ti rt' 'i 


oU 


51, 


.92 


1 3 


. 25 


76 


A9 . 


, 82 


1 1 


2 1 




Integrative 


60 




,A3 


9 , 


.85 


76 


5A. 


,68 


10 , 


, 36 




Self-Definition 


60 


A9 


18 


10, 


.65 


76 


52. 


,03 


8. 


63 




Achievement Motive 


60 


A3. 


,88 


7 




76 


A8. 


, 18 


1 1 






Affiliation Motive 


60 


A8. 


,90 


■ 10. 


.A3 


76 


51. 


,2A 


9, 






Power Motive 


60 


52.07 


10. 


,97 


76 


AS. 


62 


9. 


, b'y 


Learning 


Concrete Experience 


60 


" 15, 


02 


2 . 


, 90 


76 


15. 


68 ' 


; 


, 58 


Style 


Reflective Observation 


60 


12. 


33 


3. 


,59 


76 


15. 


25 


3. 


3A 


Inventory 


Abstract Concept-ial izat ion 


60 


17. 


48 


2. 


,80 


. 76 


15. 


5A 


3. 


,21 




Active Experimentation 


60 


15. 


77 


2. 


98 


76 


15. 


36 


2. 


, 77 




Abstract/Concrete 
























Learning Orientation 


60 


2. 


A7 


A. 


83 


76 


-0. 


lA 


A. 


59 




Active/Reflective 
























Learning Orientation 


60 


3. 


A3 


.5. 


97 


76 


0. 


11 


5. 


35 


Test of 
























Thenvatlc 




57 


1. 


63 


1. 


06 


76 


1. 


37 


I. 


,18 


Analysis 
























Analysis 


Attack 


55 


-0. 


73 


I. 


30 


72 


-0. 


78 


1. 


36 


of 
























Argument 


Defense 


5A 


-1. 


59 


0. 


98 


73 




92 


0. 


28 


Critical 


Inference 


57 


10. 


63 


3. 


06 


72 


8. 


79 


2. 


78 


Thinking 


Recognition 


57 


11. 


19 


2. 


02 


72 


10. 


72 


2. 


76 


Appraisal 


Deduction 


57 


.15. 


93 


A. 


13 


72 


15. 


53 


3. 


,09 



159 I8v5 



Table D continued 



Measure 



Source 



df 



MS 



Measure of Vocational, Educational, and Personal Issues 



''Best Class" Essay 
"Decision" Essay 
"Career" Essay 



Sentence Completion Test 



Total Protocol Rating 



Group 
Residual 



1 

130 



I .567 
0.916 



Moral Judgment Instrument 



Moral Maturity Score 



Age 
Group 
Res idual 



1 
1 
32 



6326.414 
389,421 
1120.680 



Defining Issues Test 



Group 


1 


0, 


,409 


0. 


,28 


Rep idual 


127 


1. 


478 






Group 


1 


10, 


,422 


6, 


,37* 


Res idual 


127 


1, 


,636 






Group 


1 


6 


.172 


3 


.97* 


Res idual 


126 


1 


.553 







6.08* 



5.65 * 
0 .35 



P7o Score 



Age 

Group 

Residual 



1 
1 

120 



1829.648 
4376.703 
152.835, 



11.97 *** 
28.64 *** 



D Score 



Age 

Group 

Residual 



1 
1 

120 



212. 102 
186.178 
28.596 



7.42 ** 
6.51 * 



< .01 

'2. 



160 



J So 



Table D continued 



Source 



df 



MS 



Test of Cognitive Development 



Stage of Adaptation 
Receptive 



GPA 1 
Group 1 
Residual 63 



Picture Story Exercise 



134.694 
8.389 
13.690 



Group 
Res idual 



1 

134 



218.325 
120. 147 



9 . 84 
0.61 



1.82 



Autonomous 



Group 
Res idual 



I 

134 



90.993 
L06.913 



0.85 



Assertive 



Integrat ive 



Group 
Res idual 

Group 
Res idual 



1 

134 

I 

134 



147.988 
147.642 

924.463 
102. 800 



1.00 



8.99 ** 



Self Definition 



Group 
Res idual 



1 

134 



271 .003 
91.604 



2.96 (£ < .1) 



Achievement Motive 



Group 
Res idua 1 



1 

134 



620.212 
99.176 



6.25 



Affiliation Motive 



Power Motive 



Group 
Res idual 

Group 
Residual 



1 

134 
1 

134 



183.098 
99.247 

398.678 
107.684 



1.85 



3.70 (p < .1) 



Learning Style Inventory 



Concrete Experience 



Reflective Observation 



Group 
Res idua 1 

Group 
Residual 



1 

134 
1 

n4 



14.941 
7.413 



2.02 



285.233 23.98*** 
11.892 



*£ < .05 
< .01 



161 



187 



Table D continued 







Source 


df 


MS 


F 




•X. 


Learning 


Style Inventory 


(continu ■) 








Abstract Conceptualization 


Group 
Res idual 


1 

134 


126.694 
9. 193 


13. 


78**'^ 




Active Experimentation 


Group 
Res idua 1 


1 

134 


5.675 
8.180 


0. 


69 




Abstract /Concrete 

learn orientation 


Group 
Res idual 


1 

134 


228.651 
22.092 


10. 


35** 




Act ive/ Reflective 

learning orientation 


Group 
Res idual 


1 

134 


371 .373 
31.686 


11 . 


•72 




Test of Thematic Analysis 






Group 
Res idual 


1 

131 


2.256 
1.274 


1 . 


77 




Analysis of Argument 


Attack 




Group 
Res idua 1 


1 

125 


0.080 
1 .771 


0. 


,05 




Defense 




Group 
Res idua 1 


1 

125 


3.283 
0.452 


7. 


,26 




Critical Thinking Appraisal 


Inference 




, GPA 
Group 
Residual 


1 
1 
61 


72.250 
17.485 
8.208 


8. 
2. 


80 ** 

,13 




Recogni t ion 




Group 
Residual 


1 

127 


7.050 
6.07'^ 


1 . 


.16 




Deduct ion 




up 

Res idual 


1 
1 
61 


95.063 
5.018 
12.650 


7. 
0. 


52 

,40 





**£ < .01 
***£ < .001 

16 2 

1 80 



.Data Summary for RegresfilonB on Timo of AflSL-Bsment. , 
:md A'^e anJ Educational Achlevoincnt CohortK 



Index 




Mcnsurf of Vocatlonnl , F.-iucat iona 1 , and I'eraonal Issues 



1 , 


"Bost Class" Esr.ay 


589 


3. 


29 


1. 


31 








.145 






10 ** 


2. 


Linear Time 


^89 


1 . 


84 


1. 


44 


.145 








8. 
14. 


). 


Older (vs. Traditional) 


589 


0. 


48 


0. 


50 


.176 


-.002 




.216 




81 ** 


/«. 


Above Median (vs Below) 


:">89 


0. 


45 


0. 


50 


-.04 5 


.002 


-.548 


.073 




1. 


43 




Competence Level Unity 


















(constant 


2.690) 






1 . 


"Decision" Essay 


S89 


}. 


,27 


1. 


, 31 








. 3^9 










Llnt'ar Tlr-w? 




I . 


83 


1 . 


4 3 


- .063 








b. 


6.'. ** 


\. 


'Quadrat !<■ Tlm<> 


:)a9 




, Y} 




10 


-.094 


. i 




-.44) 
.257 








4. 


Older ^vH Traditional) 


589 


0. 


,48 


0. 


,50 


. 188 


. 004 


, 004 




J \. 


, 54 ** 


5. 


Above Median (va Beiow) 


589 


0. 


,45 


0. 


,50 


-.018 


. 004 


.004 


-.554 .12A 




5 . 


82 * 




Competence Level Units 


















(cona tant 


2.803) 






1. 


"Career" Kssay 


569 


3, 


.09 


1. 


,27 
















2, 


Linear Time 


569 




.88 


1, 


.42 


.04 3 








Q. 


. 74 


}, 


Older (vs Traditional) 


569 


U 


.48 


0, 


. 50 


. 234 ' 


-.016 








16. 


. 50 ** 


. 


Above Median (vs Below) 


569 


0, 


.45 


0, 


.50 


-.119 


f02 6 


-.550 


.012 




0. 


.0? 



Competence' Level Unltn ' "-onstant 2.701) 



Sentence Completion Test 



1. Total Protocol Rat.in^^, 

2. Linear Time 

3. Older (vs Traditional) 

4. Above Median (vh Belov) 

Competence Lf'Vt?l Units 



59 7 




, J4 


0.93 










59 7 


I . 


,83 


1.4 3 


-.057 








59 7 


0. 


,48 


0.50 


.108 


. 000 






597 


0. 


,45 


0. 50 


-.093 


.000 


-.556 





.057 
.082 
.048 . 

(const ant 5, ' 



76) 



1 . 60 
1. 58 

0, 54 



1. Moril Maturity Score 

2. Lln?ar Time 

3. Older (vs Traditional) 

4. Above Median "(vs Below) 

Competence Level Units 



Moral Jud^nient InBtrument 



128 


347.03 


37, 


.89 








128 


1.85 


1 , 




.051 






128 


0. 28 


0. 


. 4 5 


.337 


-.006 




128 


0.48 


0. 


,50 


.103 


, 010 


-.29 3 



,052 
.402 
,220 

(constant 326.957) 



0.27 
1-.. lO ** 
3. 30 



Defining Issuer Test 



1. 


Score 


420 


4 5 , 


.05 


14, 


.63 












2. 


Linear Time 


420 


1 , 


.8'3 


1 . 


,44 


.285 






.285 


37.1 3 ** 


i. 


Older (va Traditional) 


4 20 


0. 


.50 


0. 


.50 


.175 


.000 




.252 


11.41 ** 


4. 


Above Median (vs Below) 


420 


0. 


,41 


0. 


4 9 


.023 


. 000 


-.509 


,152 


4,13* 




Competence Level Units 


















(constt'int 


34.212) 


1 . 


"D** Score 


420 


2 , 


.40 


6, 


.99 












2. 


Linear Time 


420 


1 , 


.83 


1. 


,44 


.221 






.221 


27. 


3. 


Older (vs Traditional) 


420 




. 50 


0, 


.50 


.28^ 


. 000 




,3AA 


19.^ 


4. 


Above Median (vb Below) 


420 


0, 


.41 


0. 


,49 


-.064 


. 000 


-. 509 


.111 


2.07 



Competence Level Units 



(consraut 22.382) 



.05 
.01 



163 



18j 



Tablo H fontlnueti 



SD 



Beta 



Test of CoKnitive Develupraent 



1 . '^co re 

2. Linear Time 

3. Older (vs Trndltlonal) 
Above Median (vs B*j1ow) 

Corapetence Level Units 



371 


12.02 


3.26 








5 7-^ 


. h 3 




.118 






573 




0.50 


-.007 


.000 




w3 


0.47 


0. 50 


.037 


.000 


-.557 



1. R'-i.. eptlve 

2. Llnenr Time 

3. Older (v9 Traditional) 

. Alx,>ve Med 1. in ' vs B(?1a)w) 
Coropetence I.t Vul Units 

1. Autonoinous 

2. Linear Time; 

3. Older (vs Tradlt 1^ nal) 
U. Above Mv^dlan (vs Below) 

Corapeten::e Level Units 



Picture Story Kxerclse 



.118 B.21^^ 
.061 . 0.7J 
.121 2.91 

(constant 10. 706) 



596 


0.U9 


0. 


,51 








596 


1.83 


,.■'1. 


,43 


-.090 






596 


0.^9 


0. 


.50 


-.087 


-.002 




'i96 


O.Ub 


0, 


.50 


.001 


-.002 





596 


0. 


,41 


0, 


.49 








596 


1. 


,83 


1 , 


.43 


.108 






596 


0. 


,49 


0, 


.50 


-.138 


-.002 




596 


0. 


,45 


0, 


.50 




-.002 


-.54 6 



090 
124 
067 

(constant 0.637) 



6.68 * 
8.02 ** 
2.25 



.107 0.55 

.161 4.65' 

.043 1.50 
(constant 0.443) 



1. Aj;sertlve 

2. Lineal Time 

3. Older (vs Traditional) 

4. Above Median (vs Below) 

Coripetence Level Units 

1. Integrative 

2. Linear Time 

3. Quadratic Time 

4. Older (vs Traditional) 

5. Above Medlan*(vs Relow) 

Competence Level Units 



1. Self-Definition 

2. Linear Time 

3. Quadratic Time 

4. Older (vs Traditional) 

5. Above Median (vs Below) 

Competence Level Units 



596 


0. 


07 


0.26 












596 


1. 


,83 


1.43 


.013 








.013 


596 


0. 


,47 


0. 50 


-.012 


-.002 






- .021 


596 


0. 


,45 


0.50 


-. 005 


-.002 


-.546 




-.017 


















( constant 


596 


0. 


, 70 


^0.46 












596 


1. 


,83 


1.43 


-.084 








.213 


596 


5. 


,41 


5.10 


.-. 104 


.961 






-.309 


596 


0. 


,49 


0. 50 


-.072 


-.002 


-.002 




-.053 


596 


0. 


.45 


0. 50 


.065 


-.002 


-.002 


-. 546 


.036 


















(cons uant 


39 7 


-0, 


.30 


0.75 












597 


1, 


.83 


1.43 


. 101 








.425 


597 


5, 


.42 


5.10 


.071 


.961 






-.^37 


597 


0, 


.49 


0.5C 


-.135 


.000 


.000 




-.173 


597 


0, 


.45 


0.50 


.025 


.000 


.000 


-.54 3 


-.069 



0.57 
0.36 
0.09 



12.42 ** 



2.12 
0.01 



2.65 

8.31** 
1 . 20 



(constant -0.264) 



1. Achievement Motive 

2. Linear Time 

J. Qundratlc Time 

4. Older (vs Traditional) 

5. Above Median (vs. Below) 

Competenfie Level Units 



597 


1.13 


0.85 






597 


1.83 


1.43 


.032 




597 


5.42 


3.10 


.105 


.961 


597 


0.49 


0. 50 


/034 


.000 


597 


0.45 


0. 50 


.013 


.000 



.000 
.000 



.543 



0. 84 



.239 
.335 

.058 0.38 

.044 0.55 

(constant 1.009) 



1. Affiliation Motive 

2. Linear Time 

3. Quadratic Time 

4. Older (vs Traditional) 

5. Above Median (vs Below) 

Corapptence Level Units 



597 


1.29 


0.66 
















597 


1.83 


1.^3 


.067 








-.357 


1. 


30 


597 


5.42 


5.10 


.099 


.961 






.441 


597 


0.49 


0. 50 


-.062 


.000 


.000 




-.066 


3. 


,66 


597 


0.4 5 


0.50 


.029 


.000 


. 000 


543 


- .006 


0. 


,07 



(constant 1.328) 



1 . Power Mot Ive 

2. Linear Time 

3. Quadratic Time 

4. Older (vs Traditional) 

5. Above Median (vs Below) 

Com"petence Level Units 



597 


1. 24 


- -0.-79 














597 


1.83 


1.43 


.112 








2. 


02 


597 


5.42 


5.10 


.083 


.961 




-.316 




597 


0.49 


0. 50 


-.022 


.000 


.000 


-.041 


0. 


,07 


597 


0.45 


0.50 


-.on 


.000 


.000 


-.1,43 -035 


0. 


33 



(constant 1.147) 



•P5 
.01 




Table K continued 



Index 



SD 

Learning Style Inventory 



Cone rete l :xperien ce 

1. Concrete Expert once 

2. Linear Time 

3. Older (vs Vradltlon.il) 

4. Above Median (vb Bo low) 

Competence Level Units 

H e f 1 ectlve Obaerva cion 

L. Reflective Observation 

2. Linear Time 

3. Quadratic Tlrau 

4. Older (vs Traditional) 
^, Above Median (vs Btilow) 

Cur.peLcnce Level Units 



Abstract Co nc eptual Izat ion 

Abstract Conceptualization 600 
Linear Time 
Quadratic Time 
Older (vs Traditional) 
Above Median (vs. Be low) 
Competence Levt^l Units 

Active Expe rime nLation 

1. Active Experimentation 

2. Linear Time 

3. Older (vs Traditional) 

4. Above Medlc.n (vs Below) 

Competence Lt^vel Units 





13.31 


3.03 












60 h 


1.83 


1.A3 


-.163 








■-. 


606 


0.49 


0.50 


.085 


.000 


— 






606 


0.46 


0.50 


-.133 


.oco 


-.539 




- • 


606 


13.76 


J . JO 












606 


1.83 


1. 3 


-.232 










606 


5.42 


5.10 


-.193 


.961 









606 


0.49 


0.50 


-.086 


.000 


.000 


— 




606 


0.46 


0. 50 


.007 


.000 


.000 


-.539 




600 


16.37 


3.57 












606 


1,83 


1.43 


.248 










606 


5.42 


5.10 


.206 


.961 








606 


0.49 


6.50 


-.141 


.000 


.000 






606 


0 . 6 


b.50 


. 193 


.000 


.000 


-.539 




606 


15.61 


3.07 












606 


i.B.3 


1.43 


.047 










606 


0.^.9 


0, 50 


.113 


.000 








606 


0.46 


C.50 


-.071 


.000 


-.539 







163 11. 

020 0-11 

122 ^.21 
(constant 16.223) 



32.6? ** 



601 
385 
116 

05-; 0.82 
jnatant 15.623) 



651 
419 
051 
166 

(constant 14 . 629) 



36.95 ** 

0. 78 
3.13 *^ 



047 1.13 

105 2.68 

014 0.05 

(constant 15.1 50) 



A bstract /Cone rete 

Learning Orientatiog 

1. Abstract/Concrete L.O. 

2. Linear Time 

3. Quadratic Jlnie 

i. Older (vs Traditional) 
5. Abo.e Median (vs Below) 
Competence Level Units 

A ctive/Reflect Ive 

Learnlpg Or ientat ion 
Active/ :-fl furtive L.O. 



1. 
2. 
3. 



Linear Tine 

Cider (vs Traditlonel) 
Above Median (vs Below) 
Competence Level Units 



606 


1.06 


.■5. 


72 










606 


1.83 


■ 1. 


43 


.241 








606 


5.42 


' 5 


10 


.210 


.961 






606 


0.49 


. 0 


50 


-.133 


.000 


.000 




606 


046 


; 0 


50 


.191 


.000 


."DO 


-.539 


606 


1.85 


: 5 


82 










606 


1.83 


; 1 


43 


.167 








606 


0.49 


! 0 


50 


.112 


.000 






606 


0.46 


I 0 


50 


-.042 


.000 


-.539 





Total Concrete Experience 
1. Concrene Experience 
Linear Time 

Older (vs Traditional) 
Above Median (vs Below) 
Competence Level Units 



2. 
3. 
4. 



Total Reflect l»'e Observation 

1. Reflertlve Observation 

2. Linear Time 

3. Older (vs Traditional) 
4,. Above Median (vs Below) 

Competence Level Units , 

Total Abstract Observation 

1. Abstract Observation 

2. Linear Time 

3. Older (vs Traditional) 

4. Above Median (vs Below) 

Competence Level Units 

*2 < .05 
**£ < .01 .. 



Adaptive Style Inventory 



.519 

.289 

.04 3 
. 168 

(constant -1 . 



.167 

. 1'26 
.026 

(c;on8 tant 



32. 34 ** 

0. 52 
8.07 



620) 



3.85 
0. 16 



-0. 244) 



398 


8.24 


4.12 












398 


2.75 


0.75 


-.010 






-.010 


0. 


398 


0.49 


0. 50 


-.129 


.000 




-.206 


7. 


398 


0.4 5 


0. 50 


-.030 


,000 


-.543 


-.142 


3. 














(constant" 9. 743) 




398 


14.24 


3.00 








\ 




393 


2.7 5 


0.75 


.011 






.011 


0. 


398 


0.49 


0. 50 


.072 


.000 




.120 


2. 


398 


0.45 


0.50 


.024 


.000 


-.543 


.089 


1 














(constant 1 3. 528) 




398 


15.11 


3.57 












398 


2.75 


0.75 


.008 






.008 


0 


398 


0.49 . 


0.50 


.026 ' 


.000 




.077 


1 


."^98 


0.4 5 


0.50 


/ .052 


.GJO 


-.543 


.094 


i 



95 ** 



08 
81 



(constant 14.420; 



165 



Table E continued 



I ndex 



Tota'. 



SD 



Ad.iptlve Style Inventory continued 



Beta 



I. Active Exper Imcut.it loxi 


393 


10.^0 


2 


88 








-.010 


2. Linear- Time 


•^98 


2.75 


0 


75 


-.010 






3. Older (vi Traditlo? I) 


3 98 


0.^9 


0 


50 




.000 




.<©e9 


4. Above Median (vs Bt-iow) 


398 


0.^5 


0 


50 


-.047 


. 000 


-. 5^3 


-.010 



Competence Level Units 



0. 08 
0.92 
0.02 



(constawC iO. .>37) 



Aj) 9 trace /Concrete 

Adapl i lve Orientation 
1. Abstract/Concrete A.O. 



Linear TLme 

Older (v9 Traditional) 
Above Median (vs Below) 
Competence Level Units 



Act ivc /Hef lect iye 

Ad ap ti ve Orientation 

1. A< 1 1 ve/Refl(^ctlve A.O. 

2. Linenr Time 

3. Older ( va. Trad it iunal) ; 

4. Above Median {vs Below)'" 

Competence i^evel Units 



398 




7. 


08 














398 


2.75 


0. 


7Z 


.n:o 






.010 


0. 


10 


3 98 


0 49 


0. 


50 


.088 


.000 




.159 


4. 


61 * 


398 


0.45 


0 


50 


. ^ .4 


.000 


-.54 3 


. 1 30 


3. 


09 
















(c^nfitant 4.677) 


« 




398 


-3.83 


5, 


03 














398 


?.75 


0 


75 


-.012 






- .012 


0 


12 


393 


0-^9 


0 


5C 


-.OCO 


.coo 




-,032 


0. 


19 


398 


0.^5 


0 


50 


-.041 


. ouo 


- . 54 .3 




0 


63 



(consCanL -1.1 91) 



Test of Thematil'.: Analyoly 



1 . 


Score 


532 


1.49 


i.i; 
















2. 


Linear Time 


582 


1.83 


l.*44 


.035 






.035 




0.4.'j 


3. 


Older (vs Traditional) 


582 


0.45 


0.50 


. 224 


.000 




. 184 




10.91 




.■\bove Median (vs Below) 


582 


0.47 


0. 50 


-. 


.000 


54 3 


-074 




1 


75 




Competence Level Units 














(constant 


'l. 328) 














Anal vs is 


of Argument 












1. 


Attack 


403 


-0.71 


1-38 
















2 . 


Linear Tine 


A 03 


1 .84 


1.43 


-.030 






-.030 




0. 


19 


3. 


Older (vs Traditional) • 


403 


0. iS 


0.4? 


.072 


-.001 




.070 




I 


20 


4 . 


Abt)ve Mee 'i (vg Belov) 


4 03 


0. 38 


0.49 


-.042 


. 002 


554 


-.00 3 




0 


OC 




Competence Level Units 














(constart 


-0.764) 






1. 


Defense? 


397 


-1,74 


0.77 


















Linear Vlme 


39" 


1.82 


1.43 


.073 






.(7S 






«;o 


3. 


Older (v3 Trad it ional) 


397 . 


0. S8 


0.49 


-.00). 


-.004 




.016 




(] 


02 


4. 


Above Median (vs Below) 


3Q7 


0. jQ 


0.49 


.021 


.003 


556 


.029 




0 


10 




(^onpctence Level Unlta 














(constant 


-1.840) 














Critical Chinking Appraisal 












1. 


Inference » 


546 


9.9\ 


3.08 
















2. 


Linear Time 


54 6 


• 1.83 


1 .44 


.130 






.130 




p 


75 ** 


3. 


Older (v9 Traditional) 


546. 


0.46 


0.50 - 


. 153 


.000 








7 


44 * 


4. 


Abovo" Median (vs Below) 


546 


0.48 


0. 50 , 


-.029 


. 000 


533 


.073 




I 


08 




Competence Level Units 














(constaijl 


Q.629) 






■J 


Recognition 


,' 5-46 


11. 19' 


2.60 
















2 . 


Linenr Time 


546 : 


1.83 


1.44 


.067 






; .225 








3. 


n.iadratlc Time 


546 


5.42 


5.11 


.037 


.961 




.3^)4 




5 


23 * 




( V9 Trad it iona) ), 


546 


0.46 


0.50 


.125 


.000 


000 


.171 




6 


62 * 




ledian (vs Below) 


346 


0.48 


0.50 


- . 005 


.000 


000 -.533 


.087 




1 


70 




;r.petekice Level Unirs 














(const Aitt 


10,471) 






1. 


Deduction 


5-5 


16i64 


3.22 


















Linear TlitD 


5''- 5 


i.84 


' i:-4^ 








.133 




10 


53 ** 


3. 


'Older (vs Traditional) 


f . 


. 0.46 


0.50 


.049 


.OO"* 




.074 




1 


06 


4.. 


Above Median (vs ^ 'Ic) 


5. j 


0.48 


0.50 


. OS'" 




Vi2 


.046 




0 


40 



Competence Level (.'nif - (constant i5.V26) 



*Z .05 
**£.< .01' 
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Table E continued 



Index 



Beta 



Life History Exercise 



1. Herfornuincu 

2. Linear Time 

3. Older (vs Traditional) 

4. Above Median (vs Below) 

Competence Level Units 



1. 



3. 
4. 



Iroproveraent ^ . 
Linear Time 
Older (vs Tr«idltlonal) 
Above median (vs I'^iow) 
Competence Level Units 



3 70 


60.62 


7.. ^8 








370 


2.73 


0.75 


.006 






370 


0.45 


0.50 


-.017 


.000 




370 


o.^a 


0.50 


.083 


-.005 


-.535 


•^70 


5.86 


22, 18 








370 


2.75 


0.75 


-.044 






370 


0.45 


0.50 


.039 


.000 




370 


0.48 


0,50 


-.018 


-.005 


-^535 



.007 O.ilO 

.038 0.30 

.103 1.H6 

(conatant Yi.^tl'l) 



.044 
. 04 I 

.004 

(conat ant 



0. 70 

0, v;' 

0.^1.' 



).472) 



1*67 
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Table F 



Sample Size, Means and Standard Deviations for Repeated 
Measures Analyses Including All Students 



First Assessment 



Second Assessment 



Third Assessment 



Measure of Vocational, Educational 
and Personal UmB 

"Best Class" Essay 
"Decision" Essay 
"Career" Essay 

Sentence Completion Test 

Moral Judgment Inscruoient 

Defining Issues Test 

PI 

D Score 

Test of Cognitive Development 

picture Story Exercise 

Stages of Adaptation 
Receptive 
Autonomous 
Assertive 
Integrative 

Self^Deflnitlon 

Achievement Motive 
Affiliation Motive 
Power Motive 



n 


M 


SD 


n 


M 




n 




. SD 


195 


3,08 


1.18 


196 


3; 24 


1.25 


196 


3.55 


1.44 


197 


3.28 


1.16 


197 


3.48 


1 1 Q 

l.lo 






liJi 


178 


3.01 


1.21, 


192 


3.11 


L15 


192 


3.16 


1.44 


199 


5 41 


0.79 


199 


5,34 


0.99 


199 


5.28 


1.00 


42 


347.40 


30.80 


43 


340.67 


43.79 


43 


353,02 


37,67 


140 


39.24 


13.61 


140 


46.61 


13.85 


140 


48.94 


14.53 


140 


25.13 


7.11 


140 


28.21 


6.73 


140 


tft OA 
10. W 




191 


11.45 


3.38 


191 


12.24 


3.11 


191 


il.il 


i.ii 


199 


51.53 


11.18 


199 


50.07 


10.09 


198 


47.90 


8.79 


199 


49.26 


9.70 


199 


50.27 


9.79 


198 


50.20 


10.19 


199 


48.56 


9.12 


199 


51.17 


10.23 


198 


49.28 


9.33 


199 


51.78 


10.74 


199 


51.15 


9.52 


198 


47.29 


9.20 


199 


48.42 


9.45 


199 


51.38 


9.88 


199 


50.33. 


10.51 


199 


50.74 


11.24 


199 


49.46 


9.44 


199 


52.12 


10.04 


199 


49.90 


9.79 


199 


48.89 


9.57 


19,9 


51.52 


10.33 


199 


47.96 


9.70 


199 


51.22 


9.80 


199 


45.49 


8.86 



ERIC 
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tab It: F coiUliulud 



\ 



Learning Style Inventory 

Coticrete Experience 
Reflective Observation 
Abstract Conceptualization 
Active Experlientatlon 

Abstract/Concrete Learning Orientation 

Actlve/RefleC-.lve Learning Orientation 

Adaptive Style Inventory 

Total Concrete Experience 
Total Refle-tlve Observation 
Totfil Abstract Conceptualization 
Total Active Experimentation 

Abstract/Concrete Adaptive Orientation 

Actlvu/Reflectlve Adaptive Orientation 

Test of Thematic Analysis 
2 

Analysis of Argument 

Attack 
.. Defense 

Critical Thinking Appraisal 

Inference 

Recognition 

Deduction 

Life History Exjrclse 

Performance 
Improvement 



First Assessment 
M SD 



:ond 'juinent 



Third A 



202 
202 
202 
202 

202 

202 



NA 
NA 
NA 



I 



196 



133 

132 



15.97 
15.04 
14.99 
15,49 

-0.98 

0.45 



0.63 
-1.77 



2.79 
3,32 
3.33 
2.64 

5.01 

5.18 



1.40 1.16 



1.48 
0.80 





M 


SD 


n 




30 


202 


15,19 


2.92 


202 


14,77 


3.24 


202 


13.13 


3,51 


202 


13.10 


3.51 


202 


1 1 AC 


J. JO 


l\JL 


17 OA 




202 


15.48 


3.35 


202 


15.87 


3.18 


202 


1,86 


5.79 


202 


2.29 


5.78 


202 


2.35 


6,11 


202 


2.76 


5.90 


199 


8.28 


4.08 


199 


8.20 


4.17 


1 QQ 




'\ in 

J. w 


177 


14 ?7 


2 90 

«•« 7v 


199 


15.08 


3.62 


199 


15.1'i 


3.52 


199 


. 10.43 


3.02 


199 


10.38 


2.75 


199 


6.80 


7.07 


199 


6.94 


7.10 


199 


-3.77 


. 5.29 


199 


-3.89 


4.77 


196 


1.57 


1.09 


196 


.. 1.50 


1.09 


189 




.34 


189 


-0.84 


1.28 


1/9 




.i.&O 


179 


-1.70 


0./ 



182 


9.38 


3.07 


182 


9 ,7 


3,06 


182 


10.36 


3.05 


182 


11.10 


2.51 


182 


10.90 


2.58 


182 


11.57 


2.68 


181 


16.10 


3.22 


182 


16.64 


3.29 


182 


17.11 " 


3.08 


na) 






184 


60.51 


7.19 


184 


60.67 


7.96 


NA^ 






184 


6.81 


23.23 


184 


4.78 


21.15 



• not applicable - Students were not given this measure at time of first assessment. 
^Not administered to 1976 Weekday College stlidents. 
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Table G 



Data Sutrrmary for Kepeated Mens. ires Analyses of Variance 
Between Entrance and Second .VtscRsmcnt 

for All Students 



Croup 



VOCStlOUfll, 

Educational, 
and Fersotial 
Inauea 



^*Bast Claas*^ Esvay 



•Dcclalon'* Eaaay 



Sant«tsce 
C<:nnpl«tlon 
T«at 



Moral Judjpnent 
Instruioent 



Betv««Q Paople 
Wtthtn P«ople 

Betveeo Measux^aa 

Kesidual 

Between People 
Within People 

Betweefa Metaurea 

Residual 

Between People 
Within People 

Between Meaauro 

Realdual 

Between People 
Within People 

Between Meaaurea 

Reaidual , 

Between People 
Within People 

Betr J en Meaauies 
ual 



194 
195 



I 

194 



196 
197 



I 

196 



177 
178 



1 

177 



198 

199 



I 

198 



41 

42 



I 

Al 



1.952 

0.985 

2.010 
0.979 

1.734 

1.030 

4.061 
1.015 

1.799 

0.952 

0.632 
0.954 

1.086 

0.523 

0.492 
0.523 

2053.052 
776.333 

1425.190 
760.508 



2.05 



4.00* 



0.66 



1,87 



Defining laeucB Teat 
PX Score 



D Score 



Teat of 
Cognitive 
Development 



Between People 
Within People 

Between Measurea 

Reaidual 

Between People 
Within Pe-'-pte 

Between Meaaurea 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Reaidual 



139 
140 

1 

139 

139 / 
140 

1 

139 

190 
191 

I 

I9d 



284-133 

119.558 

3797.763 
93.096 

79.037 
•^1.469 

661.420 
16.865 

15.560 
5.819 

59. 68? 
5.536 



40. 79^* 



39. 22^ ^ 



10. 78** 



picture 
Story 
Exercise 



StLages of Adaptation 
Receptive 



AutonocQOua 



Assertive 



Betweem Peopla 
Wj.thin People 

Between Meaaurea^ 

Reaidual 

Between People 
Within People 

Between Meaaurea 
,Realduaf 

Between People 
Within People 

Between Maaturea 

Reaidual 



198 
199 



1 

198 



198 
199. 



1 

198 



198 
199 



I 

198 



10Q.V62 
U8.698 

'211.307 
118-231 

109-151 
80.957 

101-510 
80.853 

116-721 
74.181 

674-181 
71.151 



1.79 



1-26 



9.475** 



ERLC 



*2 < .05 
< .01 

£ < .001 



170 



19 



o 



Toblo C, conllnued 



Group 



Picture Story 
Exercl&e (cont.) 

Integrative 



Self-Def Inltlon 



Achievement Motive 



Affiliation Motive 



Power Motive 



Between People 
Within People 

Between Measures 

Realduj*! 

Between People 
Within People 

Between Measures 
^ Residual 

Between People 
Within People 

Between Measures 

Resldusl 

Between People 
Within People 

Between Messures 

Resldusl 

Between People 
Within People 

Between Messures 

Resldusl 



198 
199 



1 

198 



198 
199 



1 

198 



198 
199 



1 

198 



198 
199 



1 

198 



198 
199 



198 



i;8.856 
86.':»6Z 

^0.525 
87.19? 

121.167 
69.784 

868.704 
65.749 

123.468 
92.244 

163.379 
91.884 

110.867 
76.701 

101.510 
76.576 

116.561 
78.4.')7 
1055.035 
73.525 



C..46 



13.^.1*^^ 



1.78 



1.33 



14.35*** 



EKLC 



Lesming 
Style 
Inventory 



Concrete 
Experience 



Reflective 
Observation 



Abstrsct 
ConceptusllLatlon 



Active 
Experlmentstlon 



Abstrsct/ Concrete 
Lesrnlng Orlentetlon 



Active /Reflective 
Lesming Orientation 



Adsptlve Style 
Style 
l."<ventory 

Total Concrete 
Experience 



Between People 
Within People 

Between Messures 

Resldusl 

Between People 
Within People 

Between Messures 

Residual 

Between People 
Within People 

Between Messures 

Resldusl 

Between People 
Within People 

Between Messures 

Resldusl 

Between People 
Within People 

Between Messures 

Residual 

Between People 
Within People 

Between Measures 

Resldusl 



201 
202 



1 

201 



201 
202 



1 

201 



201 
202 



1 

201 



201 

202 



1 

201 



201 
202 



1 

201 



201 
202 



1 

201 



10.203 
6.413 

61.012 
6.142 

15.294 
9.837 
368.802 
8.051 

16.390 
9.478 
430.418 
7. .^'8 3 

12.691 
5.495 

0.010 
5.522 

39.222 
23.337 

815.53') 
19.395 

45.697 
20.218 

364.990 
18.503 



9.93** 



45.81*** 



58.29*** 



0.00 



42.G5'<** 



19. 73*** 



**£ <- .01 
< .001 



^A - not appllcsble - Students were not given this measure at time- uf first ssneasment. 
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Table G contlniietl 



Group 



df 



MS 



Adaptive Style 
Inventory (cone.) 

Total Reflective 
Observat ioa 

. Total Abstract ' 
Conceptualization 

Total Active 
Experlmenta tlon 

Aba tract /Concrete 
Adaptive Orientation 

ctlve/Ref iectlve 
Adaptive Orientation 

Test of 
TheraaLlc 
Analysis 



Between People 
Within People 

Between Measures 

Residua 1 



NA 



NA 



NA 



NA 



NA 



19 
196 



1 

195 



1.517 

1.020 

2.9^9 
l.OH 



2.92 (£ < .1) 



Analysis of 
Argument 

Attack 



Defense 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



132 
133 



1 

132 



131 
132 



1 

131 



2.115 

1.861 
1.658 
1.862 

0,542 
0.473 



186 
0.476 



0. 



0.89 



0.39 



Critical 
Thinking 
Appraisal 



Inference 



Between V ople 

:i ^-leaaures 
Residual H 



181 

182 



1 

181 



13.933 
5.019 

31.453 
4.873 



6, 



Re cognition 



Between People 
Within People 

Between Measures 

Residual 



181 

182 



1 

181 



8.901 

4.049 

3.560 
4.052 



0.88 



Deduction 



Between People 
Within People 

Between Measures 

Residual 



180 
181 



1 

180 



16.033 
5.287 

26.530 
5.169 



5.13* 



Life 
History 
Exercise 



Performance 

■ •'■''-'ment 



•NA 



NA 



*£ < .05 



^NA - not applicable - Students were not given this measure at time of First assessment. 
niot administered to 1976 Weekday College students. 
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Table H 



Dnta Summary for Repeated Measures Analyses of Variance 
PeCween Second and Third /iSscsstnenc 
for Kll Students 



Measure of 
Vocational, 
Educational , 
and Persooal 
Xsaues 



"Beat Claso" Essay 



"Decision" Essay 



Group 



MS 



Between People 
Within People 

Between Measures 

Rfssidual 

Between People 
Within People 

Between Measures 

Residual 



195 
196 



1 

195 



194 
195 



1 

194 



2.160 

1.533 

9.492 
1.492 

2.171 
1.628 
19.408 
1.537 



6 36* 



12.63*** 



"Career" Essay 



Between People 
Within People 

Between Measures 

Residual 



191 
192 



I 

191 



2.250 

1.138 

0.211 
1.143 



0.18 



Sentence 
Completion 
Test 



Moral Judgment 
Instrument 



Between People 
Within People 

Between Measures 

Rea idusl 

Between People 
Within People 

Between Measures 

iXesidua 1 



198 
199 



1 

198 



42 
43 



1 

42 



1.478 

0.503 

0.362 
0.503 

2297.703 
1091.151 

•3278.616 
1039.069 



0.72 



3.16 (£ < .1) 



Defining Issues Test 
p7. Score 



Between^ People 
Within People 

Between Measures 

Residual 



139 
140 



1 

139 



317.592 
87.509 

382.590 
85.386 



4.48* 



Test of 
Cognitive 
Development 



Between People 
Wit' I'eople 

BciLween Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



139 
UO 



139 



190 
191 



1 

190 



72 J'-' 
1 

..uOO 
15.713 

15.604 
4.492 

1.508 
4.508 



1.57 



0.33 



Picture 
Story 
Exercise 



Stages of Adaptation 
Receotlve 



Autonomous 



Between People 
Within People 

Between Messures 

Re^idusl 

Between People 
Within People 

Between Messures. 

Residual 



197 
198 



1 

197 



197 
198 



1 

197 



100,904 
79,763 

437.010 
77.949 

117.877 
81.795 

0.730 
82.207 



5,61* 



0,01 



Assertive 



Between People 
Within People 

Between MessMres 

Residual 



197 
198 



1 

197 



114.521 
78.919 
368.495 
77.449 



4.76* 



.05 
,001- 
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Tabic H continued 



Group 



df 



MS 



Picture" Story 
Exercise (cont.) 

Integrative 



Self-Def Inltloa 



Betveen People 
Within People 

Between McaBures 

Realdual 

Botveen People 
Within People 

Between Meaaures 

Realdual 



197 



1 

197 



198 
199 



1 

198 



119.226 
63.671 
1481.707 
56.474 

125.170 
82.937 

109.751 
82.801 



26,24*** 



1.33 



Achievement Motive 
Aff lltdClon Motive 



Power Motive 



Learning 
Style 
Inventory 



Concrete 
Experience 



Ref lect tve 



Between People 
Within People 

Between Measures 

Realdual 

Between People 
Within People 

Between Measures 

Realdual 

Between People 
Within People 

Between Mecaurea 

Kealdunl 



Between People 
Within People 

Between Meaaures 

Rea Idual 

Between People 
ihln People 
Between Mea.iurea 
Realdual 



198 
199 



1 

198 



198 
199 



1 

198 



198 
199 



1 

198 



201 
202 



1 

201 



201 
202 



1 

201 



118. 4A^ 
7A.73/> 

705.779 
71.547 

122.803 
78., 701 
687.259 
75.627 

97.668 
77.995 

297.32^ 
76^887 



13.246 
5.884 

1 7 . 884 



18.801 
5.854 

0.062 
5.883 



9.86** 



9.09** 



3.87 (p < .1) 



0.01 



Aba tract 
Conceptuallrat ion 



Active 
Experimentation 



Between People 
Within People 

Between Meaaures 

Resldudl 

Between People 
Within People 

Between Measures 

Realdual 



201 

202 



1 

201 



201 
202 



1 

101 



16.331 
8.000 

0.010 
8.040 

16.537 
4.896 

15.059 
4.845 



0.00 



3.11 (£ < .1) 



Aba tract /Concrete 
Learning Orientation" 



Ac 1 1 ve /Ref lect ive 
Learning Orientation 



Between People 
Within People 

Between Measurrs 

Residual 

Between People ' 
Within People 

Between Measures 

Residual 



201 
202 



1 

201 



201 
202 



1 

201 



45.687 

21.186 

18.735 
21.198 

56,727 

15.463 

17.052 
15.455 



0.88 



1. 10 



Adaptive Style 
Style 
Inventory 

Total Concrete 
Experience 



Between People 
Within People 

Between He;*aure8 

Residual 



198 

199 



1 

198 



26.262 
7.809 

0.643 
7.845 



0.08 



EKLC 



*2 < .01 
*2 < .001 



174 



200 



Tnble H continued 



Adaptive Style 
Inventory (cone.)' 



Group 



df 



Total Reflective 
Observation 



Between People 
Within People 

Between Measures 

Residual 



198 

"l99 



1 

198 



12.928 
5.078 

0.425 
5.101 



0.08 



Total Abstract 
Conceptual Izat Ion 



Between People 
Within Peoplp 

Between Measures 

Residual 



198 
199 



1 

198 



18.942 
6.518 

0.362 
6.549 



0.06 



Total Active 
Experimentation 



Between People 
Within People 

Between Measures 

Residua I 



198 
199 



1 

198 



12.098 
4.375 

0.304 
4.597 



0.07 



Abstract/ Concrete 
Adaptive Orientation 



Ac t ive/ Ref 1 ec t Ive 
Adaptive Orientation 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measuies 

Res idual 



198 
199 



1 

198 



19t 
199 



1 

198 



78.228 
22.030 

1.970 
22. 131 

37.919 
12.698 

1.4." 



0.09 



^. II 



Test of ^ 
Thematic 
Annlya Is 



Between People 
Within People 

Between Measures 

Residua L 



195 
196 



I 

195 



1.469 

0.893 

0.500 
0.895 



0.56 



Analysis of 
Argument^ 



Attack 



btween People 
Ithtn People 
»^tween Messures 
Residual 



188 

189 



I 

188 



862 

.563 
0.955 
1.567 



0.61 



Defense 



Crlt>4al 
Xhfnklag 
"^Appraisal 



Between People 
Within People 

Between Measures 

Residual 



178 
179 



1 

178 



0.496 

0.444 

1.478 
0.438 



3.37 (2 <M) 



Inference 



Recojjiiltion 



Deduction 



Between People 
Within People 

Between Messures 

Residual 

Between People 
Within People 

Between Measures 

Residual 

k^etween People 
Within People ' 

Between Measures 

ResidusX 



181 



18 



X81 
182 



18 



181 
182 



18 



14.455 
4.288 

13.849 
• -4.236 

10.031 
3.997 
40.222 
3.797 

16.002 
4.396 

24.275 
4.286 



3.27 (£ < .1) 



10.59** 



5.66* 



*£ < .05 
**£ <: .01 



Not administered to 1976 Weekday Coll#iga students. 



ERIC 



175 



201 



Table K continued 



Group 



df 



MS 



Life . 
Hlsr.ory 
Exercise 



Performance 



Imp rovement 



Between People ^ 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



183 
184 



1 

183 



183 

18A 



1 

183 



81.253 
33.663 

2.446 
33.834 

494.330 

492.228 

380.098 
492.841 ' 



0.07 



0,77 



176 



202 



ERLC 



Sai,)lt' Sizt. Keans m\ Standard DevidCioiis for Re?w,tftl 
Mi.'ar,urL^s Analyses of Traditional and 
Older Cohorts 



Defining Ifl«ue'« Te«t 

PI ^ 

' D Score . 

Tcit of Cognitive Dcvelopmeat 

Picture Story Exercise 

Stages of Adaptation 
Receptive 
AittonoiQOUi 
Asaertlve 
Integrative 

Self-Deflnltlon 

Achleveiaent Hotlve 
Affiliation Hotlve 
Power Hotlve 



TRADITIOKAL 



FUfit 
Asseflsmenc 



Second 
Assessment 



Third 
AsseBSwnt 





n 


M 


SO 


a 




SD 


n 


H 


SO 


n 


H 


SO 


n 


H 


S3 


n 


M 


SD 


Heasure of Vocatlonsl, Educational 
















L 






















(ltd Peraonal l9Bu«) 






































"Beat Claai" Emy 


100 


■ 2,94 


1.20 


101 


2„90 


1.15 


101 


3,36 


1,38 


95 


3,23 


1,14 


J 


3,60 


1,26 


95 


3,76 


1.49 


"Decision" Essay 


102 


2,98 


1.19 


102 


3.20 


1,18 


ICO 


2,92 


1,38 


95 


3,60 


1,04 


95 


3,79 


1,12 


95 


3,18 


1,64 


"Career" Esaay 


90 


2.59 


1,22 


101 


2,83 


1.22 


101 


2,96 


1,39 


88 


3,44 


1,04 


91 


3.42 


0.98 


91 


3.37 


1,47 


Sentence Completion leit 


104 


5,33 


0.?3 


104 


5.24 


\M' 


104 


5.16 


1,05 


95 


5,49 


0,85 


95 


5,44 


0.88 


95 


5.40 


0.93 


Moral Judgment Initruaent 


30 


341. 8C 


30.60 


31 


334.58 


43,10 


31 


,340.90 


30.10 


12 


36,1,42 


27,73 


12 


356.42 


43,39 


12 


381.. 33 


38.25 



70 35,56 11,53 70 44.49 12,08 70 47,43 14.17 
70 23,08 6,22 70 25.87 6.21 70 27.24 6,l4 



102 11.35 3,30 



12,42 3,06 



12,34 '3,50 



102 


53,34 


12,07 


102 


50,68 


9,85 


102 


48.43 


102 


49.62 


9,, 5 7 


102 


50.70 


9,27 


102 


51.70 


102 


49,26 


9.98 


102 


51,70 


10.40 


102 


49.27 


102 


52,09 


10.77 


102 


52,25 


9,18 


102 


48,50 


102 


50,78 


10.04 


102 


52,61 


9.65 


102 


50,47 


102 


49.83 


12.47 


102 


''49.32 


8.85 


102 


52.23 


102 


49.34 


9.91 


102 


50.63 


9,46 


102 


53.26 


102 


48.61 


10,17 


102 


50.26 


9.43 


102 


49.88 



First 
AsscssMt 



OLDER 
♦ 

Assessment 



Third 
Aiiessisent 



70 


42,85 


14.53 


70 


49,01 


15.24 


70 


50,94 


14.91 


70 


27,23 


7.41 


70 


30,„55 


6.46 


70 


30.43 


6.65 


89 


11,56 


3,48 


89 


12,03 


3,18 


89 


12.39 


2,91 


97 


49.62 


9.87 


97 


49,43 


10,36 


96 


47.34 


8.10 


97 


48.88 


9,83 


97 


49.81 


10.33 


96 


48.61 


10.24 


97 


47.82 


9,25 


97 


50,61 


10.07 


96 


49.28 


9.48 


97 


51,46 


10.76 


97 


49,99 


9.78 


96 


46, CO 


8.34 


97 


45,94 


6.13 


97 


50,08 


10.00 


97 


50.16 


10.22 


97 


51,69 


9.75 


97 


49.60 


10.07 


97 


52.01 


10.23*- 


97 


50,48 


9.67 


97 


47.06 


9.40 


97 


49.68 


10. 


97 


W,29 


9.18 


97 


52.23 


10.13 


97 


49.08 


8.55 



201 



er|c 203 



Fine 
Aiuinot 



SD 



Table I 
Table I continued 



TRADITIONAL 

Stco&d 
Amnawt 

M SD 



Thitd 
Aueiittent 

H SD 



Uiblng Style Inventory 

103 15.48 2.61 103 2,79 

Concrete Experience ^j O^ 3 20 i03 13.46 ^27 

Reflective Obeervetlon ^j'jj 3 29,103 17,72 3.26 

Abitrict Conceptuilliitlon ^^'^^ 1/1,93 3.02, 

Active Experlnentitlon 

m 0 15 4 73 IW 2-77 5-35 

Abittect/Concrete Leiralng Orlentitlofl 



Flrit 

H SD 



OLDER 
Second 



iMrd 



2,94 


95 


16,48 


2.90 


99 


3,48 


99 


15,02 


3,45 


99 


3.4? 


99 


14.33 


3.26 


99 


2.87 


99 


15,44 


2.59 


99 


5,53 


99 


-2.15 


5.04 


99 


M2 


99 


0,42 


5.31 


99 



JD n « a 

3,05 99 14.60 3.55 

3.74 99 12.53 3.47 

3,74 99 16.88 J. 37 

3.59 99 16.40 ).4l 

6.10 99 2.08 6,04 

4.63 99 3.88 6.01 



CO' 



Atteck 
Defenie 



lA 

na: 



'I 



Adiptlve, style Inventory 

lotjl Concrete Erperlenci 
Totil Reflective ObMrvitlon 
Totil Abitrict ConceptuiUxitlon 
.i Totil Active Eiperlnentition 

■ \,tr.ct/Concrete Adaptive Orientation HA 
Actlve/Reflectlve Adaptive Orlentatlci NA^ 
Ttit of Theoetlc Anilysle 
AnilyjU of Arguoent^ 



102 8,70 4.23 102 8.81 4.20 

102 14.07' 3.14 102 13.9; 2.7 

102 15,09 3.55 102 1 . • 

102 10,15 2.E4 102 10.25 2.65 

102 6.39 7.21 102 6,13 7,22 

102 -3,92 .5.13 102 -3.75 4,31 

m 1.12 1,14 104 1,36 1.03 104 Ul ■1.04 



NA 
NA 

^\ 



1 



8.97 

10,96 
16.03 



3,10 
2.61 
3,18 



i56 3.12 
10.52 2.81 
16.42 3,40 



Crltlcel Thinking Appriliil 

Inference v 

Recognition 
Deduction 

Ufe Hliwry Exerclie 

Pirfonunce 

i^T^^rSJluli^^ not given thU »e..ur. 
2Hot id.mii'.t*'! to 1976 Weekdiy College .t^denti. 



91! 



9.88 
11.18 
17,02 



3,07 
2.85 
3.20 



NA 
NA^ 

10 1,74 



77 -0.43 

78 -1.67 



97 7.84 3.90 97 

9? 14.35 3.07 97 

97 15.06 3.70 97 

97 10,73 3.18 97 

97 7.23 6.93 97 

9] -3.62 5,41 97 

1,10 90 1,82 1,11 90 



7,55 4.06 

14.57 3.09, 

15.34 J.38 

10.52 2.86 

7.79 6.90 

•4,05 5.23 

1.70 1.04 



100 61.10 7i33 100 60.26 7.22 
b.3B 22.63 100 3.50 2M3 



84 
83 



na' 



9,87 
11.26 
16,19 



1 57 88 -0.7^ 1.39 88 
1,00 83 -1,86 0.59 83 



2 98 84 10.45 2,93 84 
2,40 84 11,35 2,21 84 

3 27 84 16.90 3.15 84 



B4 59.80 7.00 84 
84 7,32 24.05 84 



-0,67 1.J3 
-1.66 0.83 



10,93 2.95 
12.01 2.141 
17.31 2.95 



61.15 8.78 
6,30 ?1.20 



2O0 



Table J 



Oinn Sunnarv for Repeated Measures Analyses of Variance 
Between Entrance and Second Assessment 
for iradi t lonal Age Students 



d£ 



MS 



Mttturt of 

Voc it tonal, 
Educational, 
and Peraoxul 
laauea 



'*Bteat Claaa'* Eaaay 



♦*Declalon" Eaaay 



"Carear" Eaaay 



SentencA 
Completion 
Teat 



Moral Judgment 
loatruoent 



Between People 
Within People 

Between Meaaurea 

Realdual 

Between People 
Within People 

Between Meaaurea 

Realdual 

Between People 
Within People 

Between Meaaurea 

Realdual 

Between People 
Within People 

Between Meaaurea 

Realdual 

Between People 
Within People 

Between Meaaurea 

Residual 



99 
100 



1 

99 



101 

102 



I 

101 



89 
90 



1 
89 



103 
lOA 



1 

103 



29 

30 



1 
29 



1.906 

0.785 

0.245 
0.790 

1.687 

1.137 

2.373 
1. 125 

2.033 

0.961 

2.450 
0.944 

1.085 

0.601 

0.389 
0.603 

1878.653 
825.633 

1363.267 
807. 09A 



0.31 



2.11 



2.59 



0.6 5 



1.69 



Defining laauea Teat 
?% Score 



D Score 



Teat of 
Cognitive 
Development 



Between People 
Within People 

Between Meaaurea 

Realdual 

Between People 
Within People 

Between Meaaurea 

Realdual 

Between People 
Within People 

Between Meaaurea 

Realdual 



69 
70 



I 
69 



69 
70 



1 
69 



101 

102 



I 

10 1 



171.962 
145.214 

2786.609 
106.933 

57.709 
23.245 

273.571 
19.617 

15.098 
5.662 

58.240 
5.141 



26.06*** 



13.95*** 



11.33** 



Picture 
Story 
Exerclae 



Stages of Aij.iptat. ion 
Receptive 



Autonomoua 



Aaaertlve 



Between People 
Within People 

Between Meaaurea 

Realdual 

Between People 
Within People 

Between Meaaurea 

Realdual 

Between People 
Within People 

Between Meaaurea 

Realdual 



10 
4{)2 



1 

LOl 



lOL 

102 



i 

101 



lul 
10^ 



I 



109.624 

133. W*2 

98.782 

78.647 

59.314 
78.838 

301.400 



0.75 



**£ ' .01 
***£ «. .001 

o 

ERIC 



<'0/ 



Table J continued 



G roup 



df 



MS 



Picture Story 
Exercise (cont.) 

Integrative 



ilelf-Deflnltlon 



Achievement Motive 



Affiliation Motive 



Pover Motive 



Between People 
Within People 

Between Measurei 

Reildual 

Between People 
Within People 

Between Meaiurei 

Realdual 

Between People 
Within People 

Between Measures 

ResldusI 

Bet*#een People 
Within People 

Between Messuree 

Residual 

Between People 
Within People 

Between Measures 

Residual 



101 
102 



lOI 



101 
102 



101 



lOI 
102 



1 

101 



101 

102 



1 

101 



101 
102 



1 

101 



121.508 
77.922 

1.255 
. 78.681 

127.031 
67.873 

169.588 
66.865 

137.829 
95.029 

13.255 
95.839 

110.222 
77.515 

84.123 
77.449 

U2.076 
80.907 

140.005 
80.322 



0.02 



2.54 



1.09 



1.74 



Learning 
Style 
Inventory 



Concrete 
Experience 



Reflective 
Observation 



Abstract 
Conceptualization 



Actlv/ 
KxpcrlMatatlon 



Abstract/Concirete 
Learning Ortentstlon 



Active /Reflective 
Learning Orlentstlon 



Adaptive Style 
Style 
Inventory 

Total Concrete 
Experience 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Rejldual 

Between People 
Within People 

Between Measures 

ResldusI 

Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

ResldusI 

Between People 
Within People 

Between Measures 

Residual 



102 
103 



1 

102 



102 
103 



I 

102 



102 
103 



I 

102 



102 
103 



I 

102 



102 

103 



1 

102 



102 
103 



1 

102 



8. 849 
5.806 

14. 155 
5.724 

12.969 

9. 131 
132.160 

7.925 

14.G33 
8.961 
226.485 
6.829 

11.861 
4.709 

18.660 
4.572 

33. 315 
20.942 

353.884 
17.678 

39 . 406 

16.5/H 

51.500 
16.235 



2.47 



16.68*** 



33.17*** 



4.08* 



20.02*** 



3.i7 (£ < .1) 



NA 



EKLC 



*2 < .05 

**★£ r .001 



^NA - not applicable - Students were not given thlo mensure at time of flrat aaseasment. 



180 



Table J continued 



df 



MS 



Adaptive Style 
Inventory (cont.) 

Total Reflective 
Observat Ion 



Total Abstract 
Conceptual Isa t Ion 

Tptal Active 
Experimentation 

Ab.^tract/Concrete 
Adaptive Orientation 

Active/Reflective 
Adaptive Orientation 



Test of 
Thematic 
Analysis 



Between People 
Within People 

Between Measures 

Residual 



NA 



NA*^ 



NA 

103 
104 



1 

103 



1.349 

1.043 

3.005 
1.024 



2.93 (£ < . 1) 



Analysis of 
Arg\itoent 



Attack 



Defense 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



55 
56 



1 
55 



53 
54 



1 

53 



1.496 

1,777 

0.723 
1.796 

0.305 

0.287 

0.750 
0.278 



0.40 



2.69 



Critical 
Thinking 
Appraisal 



Inference 



Recognition 



Deduct Ion 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



97 
98 



I 
97 



97 
98 



1 
97 



97 
98 



1 
97 



14.507 
5.010 

17.163 
4.885 

9.765 

4.985 

9.434 
4.939 

15.702 
6,010 

7.367 
5.996 



3,51 (£ ■■■ .1) 



1.91 



1.23 



Life 
History 
Exercise 



Perf onoance 
Improvement 



NA 



^NA - not appUcnble - Students were not given this meflHurc «t trlme of flrBt. BHscBoment. 
2Not fldminlstertul to 1976 Wcekdny College students. 
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Table K . ^ 

Data Summary for Repeated Measures Analyses of Variance 
Between Second and Third Assessnie-vt 
for Traditional Age Students 



Group 



.d£ 



MS 



Mttture of 
Vocttiontl, 
EducationaU 
•nd Ptrsbnil 
Ittu«t 



"Best Cl«a«" Es««y 



**Dtcltlon" Etaay 



'*Csr««r" Essay 



Betvaen People 
Wtthln People 

Betvcen Messures 

Residual 

Betnraen People 
Within People 

Becveen Measures 

Residuel 

Between People 
Within People 

Between Meesurss 

Residuel 



100 
101 



1 

100 



99 
100 



1 
99 



100 
101 



1 

100 



1.907 
1.426 

10.^75 
1.335 

1.825 • 

1.515 

A. 205 
1.A88 

2.2A3 

1.173 

0.837 
1.177 



7.85** 



2.83 (£ < 



0.71 



Stntecce 
Conpletion 
Teat 



Moral Judgment 
Inatruoent 



Between People 
Within People 

Between Meaauraa 
-^Reaidual 

Between People 
Within People 

Between Meaaurea 

Realdual 



103 
lOA 



1 

103 



30 
31 



1 
30 



1.71A 

0,548 

0.308 
C.550 

1789.396 
962.516 

619.613 
973.946 



0.56 



0.64 



Defining laauea Teat 
FX Score 



Between People 
Within People 

Between Meaauraa 

Realdual 



69 
70 



1 
69 



266.562 
83.295 

303.114 
80,110 



3.78 (£ < 



D Score 



Teat of 

Cognitive 
Developmen^ 



Between People 
Within People 

Between Meaauraa 

Reaiduat 

Between Ptiople 
Within People 

Between Meaaurea 

Realdual 



69 

70 



1 
69 



101 
102 



1 

101 



59.833 

17.108 

65.475 
16. 4o; 

16.784 
4.775 

0.314 
4.819 



3.99* 



0.07 



Picture 
Story 
Exercise 



Stages of Adaptation 
Receptive 



Between People 
Within People 

Between Meaaurea 

Reaiduel 



lOl 
102 



I 

101 



98.455 
88.613 

257,064 
86.945 



2.96 (£ 



Autou)»moua 



Between People 
Within People 

Between Meaauraa 

Realdual 



lOl 
102 



1 

lOl 



102.912 
82,000 

51.000 
82,307 



0.62 



Aaaertlve 



Between People 
Within People 

Between Meaauraa 

Realdual 



lOI 
102 



I 

lOI 



105.193 
90.495 

299.064 
08.430 



3.38 (p 



*£ < .05 

*^r£ < .01 
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Table K continued 



Group 

Picture Story 
Exercise (cont.) 

Integrative Between People 

Within People 

Between Meaiurea 
Refldual 

Self-Def Inltlon Between People 

Within People 
Between Meaaures 
Residual 

Achievement Motive Between People 
Within People 

Between Meaaurea 
Residual 

Affiliation Motive Between People 
Within People 

Between Measures 
Residual 

Power Motive Between People 

Within People 

Between Meaaures 
Residual 

Learning 

Style 
\ Inventory 

Concrete Between People 

Experience Within People 

Between Measures 
Residual 

Reflective Between People 

Observation Within People 

Between Measures 
Residual 

Abstract Bctveen People 

Conceptuallratlon Within People 

Between Measures 
Residual 

Active Between People 

Experimentation Within People 

Between Measures 
Residual 

Abatract/Concrete Between People 

Learning Orientation Within People 

Between Measures 
Residual 

Actlve/Ref lectlve Between People 

Learning Orientation Within People 

Between Meaaures 
Res Idua I 

Adaptive Style 
Style 
Inventory 

Total Concrete Between People 

Experience Within People 

Between Measures 
Resldusl 



df MS 



101 122.987 

102 64.216 

I 715.314 12.38*** 

101 57.769 

101 120.551 

102 91.108 

1 232.961 2.60 

101 89.703 

101 108.422 

102 71.696 

1 429.490 6.30* 

101 68.154 

101 117.039 

102 77.936 

1 354,711 4.72* 

101 75.196 

101 92.776 

102 79.023 

1 7.456 0.09 

101 80.337 



102 10.793 

103 5.568 

1 2.141 0.38 

102 5.602 

102 16.513 

103 6.218 

1 2.141 0.34 

102 6.258 

102 lM.646 

103 8.053 

1 11.655 ^-^^ 

102 8.018 

102 13.935 

103 3.490 

1 8.976 2.61 

102 3.437 

102 38.500 

103 'i0.5l5 

I 3.806 0.18 

102 20.678 

102 46.962 

103 14.369 

1 2.350 0.16 

iOI 14.487 



101 26.235 

102 9.235 

I 0.706 0.08 

lOl 9.320 



.05. 
.01 



EKLC 
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Table K continued 



d£ 



Adaptive Style 
Inventory (coat.) 

Total Reflective 
Observetlon 



Total Abatract 
Conceptualisation 



Totfl Active 
Experimentation 



Abatrac t/Concrete 
Adaptive Orientation 



Active/Reflective 
Adaptive Orientation 



Teat of 
Thematic 
Analyaia 



Between People 
Within People 

Between Meaaurea 

Real dual 

Between People 
Within People 

Between Meaaurea 

Reaidual 

Between People 
Within People 

Between Mea^v.rea 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Reaidual 

Between People 
Within People 

Betwsen Mzaaurea 

Reaidual 



lOl 

102 



1 

101 



101 
102 



1 

101 



101 
102 



1 

101 



101 

102 



1 

101 



101 
102 



1 

101 



103 
104 



1 

103 



12.048 
5.049 

0.314 
5.096 

19.826 
6.142 

1.103 
6.192 

10.784 
4.265 

0.490 
4.302 

80.710 
23.191 

3.574 
23.385 

34.221 . 
11.098 

1.588 
11.192 

1.326 

0.822 

0. 120 
0.829 



0.06 



0.18 



O.ll 



0.15 



0.14 



0.15 



Analysis of 
Argiiroent^ 

Attack 



Defense 



Between People 
Within People 

Between Meaaurea 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Reaidual 



100 
101 



1 

101 



95 
96 



I 

95 



1.515 

1.683 

3.347 
1.667 

0.399 

0.453 

0.255 
0.455 



2.01 



0.56 



Critical 
Thinking 
Appraiaal 



Inference 



Recognition 



Deduction 



Between People 
Within People 

Between Meaaurea 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Reaidual 



97 
98 



1 

97 



97 
98 



1 

97 



97 
98 



1 
97 



14.908 
4.301 

4.903 
4.295 

11.662 ^ 
4.505 

21.556 
4.329 

17.908 
4.026 

17.760 



1.14 



4.9a* 



4.57* 



.05 ^ot adminiatered to 1976 Weekday College students. 
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Table K continued 



Group 



df MS 



Life 
History 
Exercise 



Performance o Between People ^9 W'llt 

Within People 100 ''''^280 1.04 



Betveen Meaiurei 
Residual 



99 33.957 



Improvement 



Between People 99 533.508 

Within People ^ 100 ^".100 



Between Measures 
Residual 



\ 414.720 0.98 

99 425.205 



ERIC 



Table L 



Data Summary for Repeated Measures Analyses of Variance 
Between Entrance and Second Assessment 
for Older Students 



df 



MS 



Measure of 
Vocational, 
Educational, 
and Personal 
laaues 



"Best Class" Essay 



"Decision" Essay 



"Career" Esssy 



Sentence 
Completion 
Test 



Moral Judgment 
Instrument 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Resldusl 

Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



94 
95 



1 

94 



94 
95 



1 

94 



87 
88 



I 

87 



94 
95 



1 

94 



11 

12 



I 

a 



1.752 

1.195 

6.447 
1.139 

1.418 

0.916 

1.705 
0.907 

1.075 

0,943 

0,205 
0.952 

1.062 

0.437 

0.132 
0.440 

1953.167 
653.083 

150.000 
698.818 



5.66* 



1.88 



0.21 



0. 30 



0.21 



Defining Issues Test 
P% Score 



D Score 



Test of 
Cognitive 
Development 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Recldual 

Between People 
Within People 

Between Measures 

Residual 



69 
70 



1 

69 



69 

70 



1 

69 



88 
89 



1 

88 



369.017 
92.402 
1330.561 
74.458 

82.202 
19.756 

385.499 
14.456 

16.258 
6.000 

9.910 
5.956 



17,87*** 



26.67*** 



1.66 



Picture 
Story 
Exercise 



Stages of Adaptation 
Receptive 



Autonomous 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



96 
97 



1 
96 



96 
97 



1 
96 



101.598 
10l,14A 

1.670 
102.181 

120.514 
83.387 

42.686 
83.811 



0.02 



0 .51 



Assertive 



Between People 
Within People 

Between Measures 

Residual 



96 
97 



1 

96 



109.957 
80 . 1 34 

375.773 
7/. 054 



4.88* 



.05 
,001 
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Table L continued 



Group 



d£ 



MS 



Hcture Story 
Exercise (cont.) 

Integrative 



Self -Definition 



Achievement Motive 



Affiliation Motive 



Pover Motive 



Between People 
Within People 

Between Meaturei 

Residual 

Betveen People 
Within People 

Betveen Messures 

Residuel 

Between People 
Within People 

Between Measures 

Residual 

Betveen People 
Within People 

Betveen Measures 

Residusl 

Between People 
WithiC People 

Between Measures 

Residual 



96 

97 



I 

96 



96 
97 



I 

96 



96 

97 



I 

96 



96 
97 



I 

96 



9b 
97 



1 

96 



115.156 
96.469 

105.407 
96.376 

102.187 
71.794 

833.010 
'63.864 

108.468 
89.314 

212.416 
88.032 

111.177 
75.845 

568.165 
70.717 

122.387 
75.881 
1182.686 
64.352 



1.09 



13.04*** 



2.41 



8.03** 



18.38*** 



Learning 
Style 
Inventory 



Concrete 
Experience 



Reflective 
Observation 



Abstract 
Conceptual isation 



Active 
Experimentation 



Betveen People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Betveen Measures 

Residual 

Between People 
Within teople 

Between Messures 

Residual 

Betveen People 
Within People 

Betveen Measures 

Residual 



Abstract/Concrete Betveen People 

Learning Orientation Within People 

Betveen Measures 
Residual 

Active/Reflective Betveen People 

Learning Orientation Within People 

Between Measures 
Residue 1 



98 
99 

1 
98 

98 -v 
99 

1 
98 



98 
99 



1 
98 



98 
99 



1 
98 



98 

99 



1 
98 



98 
99 



1 

98 



11.135 
7.045 

53.^81 
6.571 

17.742 
10.571 

246.672 
8.162 

16.586 
10.015 

204.045 
8.035 

13.412 
6.313 

18.182 
6.192 

41.345 
25.828 
466.747 
21.329 

51.935 
24.005 

398.793 
20.181 



8.15** 



30,22*** 



2.94 (£ < .1) 



■ 1 . 88*** 



19.76*** 



Adaptive Style 
Style 
Inventory 



Total Concrete 
Experience 



^£ < .01 
***£ ' .001 



^NA - not applicable - Students were not given this meaeure at time of first .^esessment. 
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Table L continued 



Group 



d£ 



MS 



Adaptive Style 
Inventory (cont.) 



Total Reflective 
Obiervat ion 

Total Abv^racc 
Conceptualisation 

Totai Activr 
Experimentation 

Abstract /Concrete 
Adaptive Orientation 

Active /Reflective 
Adaptive Orientation 



Test of 
Thematic 
Analysis 



Between People 
Within People 

Between Measures 

Residual 



NA 



HA 



NA 



NA 



NA 



89 
90 



1 

89 



1.A28 

0.99A 

0.272 
1.003 



0.27 



Analysis of 

Argument^ 

Attack 



Defense 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Reni^LMBl 



76 

77 



1 

76 



77 

78 



1 

77 



2.555 

1.922 

5.8AA 
1.870 

0.710 

0:603 

1.641 
0.589 



3.12 (£ < .1) 



2.79 (£ < .1) 



Critical 
Thinking 
Appraisal ; 

Inference 



Recognition 



Deduction 



Between People 
Within People 
. Between Measures 
Residual 

Between People 
Within People 

Between Meaaures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



83 

8A 



1 

83 



83 
8A 



I 
83 



82 
83 



1 
82 



12.556 
5.030 

14.292 
A. 918 

7.651 

2.958 

0.292 
2.990 

16.500 
A.A3A 

21.687 
A. 223 



2.91 (£ < .1) 



0.10 



5.13* 



Life 
History 
Exercise 



Performance 
Improvement 



NA 



NA 



.05 



'NA 



not applicable - Students were not given this measure at tiro- of. first assessment. 



^Not adminiatered to 1976 Weekday College studenta. 
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Table M 



Dnta Summary for Repeated Measures Analyeea of Variance 
Between Second anu Third Assessment 
for Older Students 



Group 



df 



MS 



Measure of 
Vocational, 
Educational, 
and Personal 
Xffuea 



♦•Besr; Class" E«9ay 



"Oeclalon" Easay 



"Career" Essay 



Sentence 
Coii;pletlon 
Test 



Moral Judgmen;; 
Instrument 



Petween People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measurt^s 

Residual 

Between People 
Within People 

Between Measurca 

Realdual 

Between People 
Within People 

Between Meaeurir^s 

Residual 



94 
95 



1 
94 



94 
95 



I 

94 



90 
91 



1 

90 



94 
95 



1 
94 



11 
.12 



1 
11 



2.137 

1.647 

1.184 
1.652 

2.377 
1.747 

17.705^ 
1.578 

2.017 
1.099 
« 0.088 
l.lld 

1.184 

0.453 

0.084 
0.457 

2217.830 

1423.458 

4676.042 
1127.769 



0.72 



11.22** 



0.08 



0.18 



4.15 (£ < .1) 



Defining Issues Test 
P% Score 



Test of 
Cognitive 
Development 



Between People 
Within People 

Between Measures 

Resldusl 

Between People 
Within People 

Between Meaaures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



69 
70 



1 

69 



69 

70 



1 
69 



88 
89 



1 

38 



362.732 
92.358 

129.408 
91.821 

70.976 
14.707 

0.471 
14,913 

14.396 
4.169 

5.753 
4.151 



1.41 



0.03 



1.39 



Picture 
Story 
Exercise 



Stages of Adaptation 
Receptive 



Autonotnous 



Assertive 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 

Between I-sople 
Within People 

Between Meaaures 

Residual 



95 
96 



1 
95 



95 

96 



1 

95 



95 
96 



1 

95 



102.980 
70.359 

182.130 
69.183 

131.021 
81.578 

73.755 
81.660 

125.384 
66.620 

V4.922 
66.322 



2.63 



0.90 



1.43 



*£ < .01 



EKLC 
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Table M continued 



Group 



df 



MS 



Ptctur* Story 
Exercise (cont.) 

Iategrati\* 



Stlf-Daflnltlon 



Achleveneat Motive 



Afflll*.tlon Motive 



Power Motive 



Between People 
Within People 

Between Meaiuret 

ReiU'ual 

Between People 
Within People 
• Between Mc&iures 
Reilduil 

Between People 
Within People 

Between Measures 

R<i8ldual 

Between People 
Within People 

Between..Measures 

Residual 

Between People 
Within Feople 

Between Measures 

Residual 



95 
96 



1 

95 

96 
97 

1 
96 

96 ' 
97 

1 
96 

96 ' 
97 

1 
96 

96 

97. 

1 
96 



110.621 
63.094 

768*000 
55.674 

129.274 
74.345 

n.418 
' 75 .115 

130.225 
77.928 

2^2.247 
75.800 

116.909 
79.505 
332.557 
76.869 

103.483 
76.284 

479.510 
72.083 



13.79*** 



O.Ol 



3.72 C£ < -Ol) 



4.33* 



6.65* 



I^eavnlng 
Style 
Inventory 



Concrete 
Exper lence 



Reflective 
Obaervat Ion 



Abstract 
Conceptuallratlon 



Active 
■ Experimentation 



Abitract/Concrcte 
Learning Orientation 



Actlve/Ref lectlve 
Learning Orientation 



Between People 
Within People 

Between Measures 

F^iesldual 

Between People 
Within eople 

Between Meaaurr'S 
' Real dual 

Betviexi People 
Within People 

Between Meaaures 

Reaidu&l 

Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between' Measures 

Residua^ 

Between People 
Within People 
> Between Measures 
Residual 



98 
99 



I 
98 



98 
99 



1 

98 ^ 



98 
99 



1 
98 



98 
99 



I 
98 



98 
99 



1 
98 



98 
99 



1 
98 



15.858 
6.212 
20.687 
6.064 

20.537 

'5.475 

3.414 
5.496 

17.491 
7.944 

13.136 
7.891 

18.197 
6.359' 

6.187 
6.360 

52.316 

21.884 

66.793 
21.426 

63.398 
.16.601 
" 18.793 
* 16.579 



3.41 (£ < .1) 



0.62 
1.66 



0.97 



3.12 (£ < .1) 



1.13 



Adaptive Style 
Style 
Inventory 

Total Concrete 
Experience 



Between People 
Within "People 

Between Measures 

Residual 



96 
97 



' 1 
96 



25.390 
6.309 

4.041 
6.333 



0.64 



*£ < .05 



ERIC 



190 



Tab If M continued 



Group 



MS 



Adaptive Style 
Inventory (cont,) 

local Reflective Between People 

Observation Within People 

Between Measures 
Residual 

Between People 
Within People 

Betveen Measures 
Residual 

Betveen People 
Within People 

Between Meaeures 
Realdual 

Between People 
Adaptive Orientation Within People 

Between Measures 
Residual 

Active/Retlective Between People 

Adaptive Orientation Within People 

Between Measures 
Residual 



Total Abstract 
Conceptuslisation 



Total Active 
Exper iroentst ion 



Abstract/Concrete 



Test of 
Theuatic 
Analysis 



Between People 
Withir People 

Between Measures 

Residual 



96 
97 



1 
96 



96 
97 



1 

96 



96 

97 



L 
96 



96 
97 



I 
96 



96 
97 



I 

96 



89 
90 



1 
89 



13.799 
5.108 

2.273 
5.138 

18.174 
6.912 

3.758 
6.945 

13.396 
4.902 

2.273 
4.929 

74.812 

20.809 

15.593 
20.864 

42.205 
14.381 

9.093 
14.437 

1.373 

0.939 

0.672 
0.942 



0.44 



0.54 



0.46 



0.75 



0.63 



0.71 



Analyais of 
Argument ^ 

Attack 



Def enae 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



87 
88 



1 
87 



82 

83 



1 

82 



2.261 

1.426 

6.278 
1.439 

0.614 

0.434 

1.542 
0.420 



0.19 



3.67 (£ .1) 



Critical 
Thlnkir^ 
Appraisal 



Inference 



Recognition 



Deduction 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 

Betveen People 
Within People 

Between Measures 

Residual 



83 

84 



1 

83 



83 
84 



1 
83 



83 

84 



1 
83 



13.071 
4.274 

9.524 
4.211 

7.502 
3.405 

18.667 
3.221 

13.799 
4.827 

7 292 
'...798 



2.26 



5.80* 



1.52 



★£ < ,05 



^ot adminiatered to 1976 Weekday College students. 




L91 



213 



Table M continued 



Group 

Life 
Hlatory 
Exerciae 

Pcrfonnance Between People 

Within People 
Between Measures 
Residual 

ImprovemcnC Between People 

Within People 

Betveen Measures 
Residual 



df MS E 



83 93.360 

84 33.298 

1 77.357 2.36 

83 32.767 

83 4A9.710 

8V 572.143 

I 44.024 0.08 

83 578.506 



EKLC 
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Table II 



S.iaiik' 5i?..', llc-'ins and Standard Devi.itiotis fur Sc[iLMted 
Hwisiircs Analyse? of liifih and low 
Ediifiitional klilcvemcnt Cohorts 



First 
Assessment 

n H SD n 



m CLC 

Second 
Assessment 



Third 
Assestment 

SD n H SD 



92 3.09 l.Oa % in 11^ % 3,54 l.M 

93 3,25 1.19 '}5 3.65 1.16 95 3,05 1.47 
85 3.12 1.16 9^ 3.18 1.20 % 3,21 1.38 

93 5,48 0.80 99 5,26 0.92 99 5,23 0.87 

13 332.31 33,92 21 349.43 31,59 21 370.67 33.65 



Flrat 
Assessment 



Second 
Assessment 



Third 
Assessment 



SD n 



SD 



SD 



103 3.08 1.27 103 3,22 1.27 
m 3.31 1.14 104 3,50 1.25 
93 2.91 1.25 98 3,04 1.09 



3,56 1.40 
3.04 1.57 
3,10 1.50 



69 


38,50 


12.46 


74 


48.61 


13.80 


74 


51,28 


14,97 


71 


69 


24.09 


6,61 


74 


29,44 


6.02 


74 


29.51 


7.03 


71 


88 


11.28 


3,46 


93 


12.27 


2.87 


93 


12.33 


3.23 


103 



92 


50,64 


11,47 


101 


48,76 


9.13 


101 


92 


49,39 


9.17 


101 


50,54 


9,72 


101 


92 


47,90 


9,87 


101 


51,27 


10,45 


101 


S2 


51.64 


11.20 


101 


51,02 


9.86 


101 


92 


48.51 


9.42 


102 


49.91 


10.05 


102 


92 


49.58 


10.60 


102 


48.95 


9.73 


102 


92 


49,32 


9,36 


102 48,50 


9.50 


102 


92 


47,58 


9.85 


102 


51.57 


10.95 


102 



106 5.34 0.78 106 5,33 1,10 100 5.32 1.12 
29 354.17 27,26 29 350.31 42.68 22 336.18 33.92 



103 11,59 3.31 



12.79 2,93 



12.40 3.25 



50.35 10.40 107 
46.94 9.20 107 



10.03 107 
10.39 107 



52,29 


10,93 


107 


50,04 


9,71 


97 


48,22 


9.50 


49,14 


10,18 


107 


50.18 


8,94 


97 


50,45 


9.85 


49.13 


8.43 


107 


51.75 


10,63 


97 


48,16 


7.97 


51.91 


10,39 


107 


52,56 


8.95 


97 


47,65 


9,23 


48.35 


9,53 


107 


50.24 


9.93 


97 


49,25 


10,8D 


51.74 


11.71 


107 


50,07 


9,72 


97 


53,30 


9.98 


50.40 


9J5 


107 


49,21 


9,78 


97 


51,66 


10,33 


48.30 


9.60 


107 


51,16 


10.15 


97 


49,66 


9.34 
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Tahh' ^ 'UiUiiiiu''. 



First 

Assessnifint 



Second 
Assessment 



Third 
Assessraent 



Learning Style Inventory 

Concrete Experience 
Reflective Observation 
Abstract Conceptualization 
Active Experimentation 



Adaptive Style Inventory 



Total Concrete Experience 
Totfll Reflective .Observation 
Total Abstract Conceptualization 
Total Active Experimentation 



Test of Thematic Analysis 
2 

Analysis of Argument 



Attack 
Defense 

Critical Thinking Appraisal 

Inference 

Recognition 

Deduction 

Life History Exercise 

Performance 
Irtiprov'eroent 



n 


H 


SD 


n 




SD 


n 


H 


SO 




















% 


16,36 


2,88 


100 


14,93 


3,03 


100 


14,41 


3,21 




15.03 


3,24 


100 


12,69 


J. 43 


100 


n 7^ 




% 


14,63 


3,12 


100 


T "I 11 


J.dB 


lUl) 


i/.y 




^4 


15,63 


2,37 


100 


15.91 


3,38 


lUU 


Id. 15 


J. J/ 


54 


•1,?] 


4,78 


100 


2.18 


6,05 


100 


3,02 


5,70 


94 


0,60 


4.80 


100 


3,22 


6.03 


100 


m 


5,95 








98 


8,00 


4,12 


w 


IM 


4,08 








98 


14.11 


2,88 


% 


Ml 


2,83 








98 


15.15 


3,63 


% 


15.45 


3,51 


.,.1 






98 


11), ;1 


J.W 


Oft 


in ^9, 


4, DO 








98 


7,15 


7,15 


98 


7,83 


6,96 








98 


•3,40 


5,11 


98 


■3,53 


4,57 


87 


1,46 


1,23 




l.bU 


l.UO 




1 SI 
i. ji 


1 (15 


64 


■0,47 


1.51 


94 


-0,83 


1,32 


94 


■0,83 


1.37 


65 


-1,75 


0,87 


89 


■1,85 


0.58 


89 


■1.73 




80 


8.66 


2.77 


90 


10.64 


3.02 


90 


10,69 


3.15 


80 


10.78 


2.56 


90 


11,07 


2.62 


90 


11,89 


2,73 


79 


15,62 


3,15 


90 


16,94 


3.35 


90 


17.58 


2.98 








88 


60.20 


7.36 


88 


59.73 


8.52 








88 


4.23 


20.82 


88 


4,77 


22,291 



First 
Assessment 



,ii "Mi 
AsaesBinent 



Third 
Assessment 



106 15.63 

108 15,05 

108 15,31 

108 15.37 



10? 



69 
67 



102 
102 
102 



,78 





n 


!1 


SD , 


n 


H 


SO 


2,63 


108 


14,99 


2,99 


102, 


15,13 


3,25 


3.39 


108 


12,69 




1 no 
ID/ 




J.JO 


3.48 


108 




J. 32 


im 




1 M 


0 rtc 

2.86 


108 


15.48 


3,11 


lUZ 




1,71 


5.13' 


108 


2,65 


5,64 


102 


1,58 


5,79 


5,51 


108 


2,80 


5.59 


102 


2,11 


5.80 




101 


8,54 


4,05 


101 


8,75 


4.21 




101 


14,30 


3,31 


101 


14.33 


2,98 




101 


15,00 


3.62 


101 


14.83 


3,52 




101 


lU.lb 






in Oft 


') An 




101 


6.46 


7,01 


101 


6.08 


7,16 




101 


■4,14 


5,45 


101 


■4.25 


4,95 


1,11 


10/ 


1 u 






l.H/ 


L ,U0 


1.44 


95 


'0.64 


1.36 


95 


■0.84 


1,19 


0,73 


on 


1 fli 

"i.Oi 


u*oj 




■I 68 


0 80 


3.19 


102 


10,25 


3,21 


92 


10,04 


2.93 


2,46 


102 


11,11 


2.71 


92 


11,25 


2,60 


3.24 


102 


16.87 


3.54 


92 


16.75 


3.14 




96 


60.78 


7.06 


96 


61,53 


7.35 




96 


9,18 


25.12 


96 


4,78 


20,17 



^W- not appllcabU - Students verc not given this Masure ec time of first assessment, 

^Not adiDlnlsteted to 1976 yeekday College students. 

fERlC 
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TabU' 0 



;)at.i Sdiiimary for Xopeatcd Measures Analyses of Variance Hulwccn 
Kiurancf and Second Aissessmt-nt for Studonfs in Low 
Kilucatlonal Achl oveinent Ctihort 



Group 



df 



MS 



Measure of 
Vocadonsl > 
Educational, 
•ad Peraonel 
lasuet 



"Beat Class" Easay 



'♦Decision" Essay 



"Career" Essay 



Sentence 
Completion 
Test 



Moral Judgment 
Instrument 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Resldusl 

Between People 
WlLhin People 

Between Measures 

Resldusl 



91 

92 



I 
91 



92 
93 



1 
92 



84 
85 



1 
84 



92 

93 



1 

92 



12 
13 



1 
12 



1.637 

0.995 

0.918 
0.995 

1.474 

1.194 

2.151 
1.183 

1.564 

0.994 

0.053 
1.005 

0.996 

0.382 

0.909 
0.376 

1742.545 
677.000 

2106.000 
557.917 



0.92 



1.B2 



0.05 



mi 



3.77 (£ < .1) 



Defining Issues Test 
Score 



D Score 



Test of 
Cognitive 
Development 



Between People 
Within People 

Between Measures 

Resldusl 

Between People 
Within People 

Betvcen Measures 

Resldusl 

Bi^tween People 
Within People 

Betveen Mesrures 

Residual 



68 
69 



1 
68 



68 
69 



1 
68 



87 

88 



1 
87 



259.862 
108.417 

1107-833 
93.720 

83.208 
23.173 

533.246 
15.67?. 

15.867 
6.443 

4.455 
6.466 



11.82*** 



34.03^** 



0.69 



Picture 
Stcry 
Exercise 



ERIC 



Stages of Adaptation 
Receptive 



Autonomous 



Assertive 



*£ < .U5 
**£ <.001 



Between People 
Within People 

Between Measures 

Resldusl 

Between People 
Within People 

Between Measures 

Residual 

Betveen People 
Within People 

Betveen Massures 

Resldusl 



195 



91 
92 



1 
91 



91 
92 



1 
91 



91 
92 



1 
91 



22.: 



105.271 
136.625 

13.049 
137.983 

112.916 
86.022 

44.022 
86 .483 

115.538 
79.663 

307.848 
77.156 



0.09 



0.51 



3.99* 



Table 0 continued 



Croup 



df 



MS 



Picture Story 
Exercise (cont.) 

Integrative 



S«lf-Def Inltlon 



Achlevemenr. Motive 



Affiliation Motive 



Pover Motive 



Between People 
Within People 

Between Meaaurea 

Raaldual 

Between People 
Within People 

Between Mecauraa 

Residual 

Between People 
Within People 

Between Meaaurae 

Realdual 

Between People 
Within People 

Between Meaaurea 

Residual 

Between People 
Within People 

Between Meaaurea 

Residual 



91 
92 



1 

91 



91 
92 



I 

91 



91 
92 



I 
91 



91 

92 



1 

91 



91 

92 



1 

91 



121.061 

10^.310 

210.918 
103.138 

120.643 
70.408 

805.571 
62.329 

108.661 
86.054 

31.391 
86.655 

103.479 
80.826 

29.761 
81 .387 

109.035 
83.076 

635.674 
7 7.004 



2.0!) 



12.92*** 



0.36 



0.37 



8.26** 



Learning 
Style 
Inventory 



Concrete 
Experience 



Reflective 
Obaervctlon 



Abstract 
Conceptuallxatlon 



Active 
Exp a r Imen t a c 1 on 



Between People 
Within People 

Between Measures 

Realdual 

Between People 
Within People 

Between Measurea 

Rea Idual 

Between People 
Within People 

Between Meaaurea 

Realdual 

Between People 
Within People 

Between Meaaurea 

Realdual 



Abstract/Concrete Between People 

Lesmlng Orlentstlon Within People 

Between Measurss 
Rssldusl 

Actlve/Reflectlve Bet%reen People 

Leaning Orientation Within People 

Between Meaaurea 
Realdual 



93 

94 



1 
93 



93 
94 



I 

93 



93 
94 



1 
93 



93 
94 



I 

93 



93 
94 



I 

93 



93 
94 



1 
93 



8.579 
8.191 

41.191 
7.837 

16.445 
8.410 

91.282 
7.518 

15.371 
9.782 
. 144.814 
8.330 

13.747 
5.021 

1.043 
5.064 

33.647 
26.867 
340.473 
23.495 

50.662 

17.261 

72.814 
16.663 



5.26* 



12. 14*** 



17.38**" 



0.21 



14.49*** 



4.37* 



Adaptive Style 
Style 
Inventory 

Total Concrete 
Experlanca 



NA 



*£ < .05 
**£ < .01 
***£ < .001 



^NA - not applicable - Students were not given this measure at time of first assessment. 



EKLC 



196 



226 



Tab It' 0 font Irmoii 



Group 



(if 



MS 



Adaptive Style 
Inventory (cont.) 

Total Reflective 
Observation 



Total Abstract 
Conceptual I rat ion 



NA 



Total Active 
Experimentation 



NA 



Aba tract/Concrete 
Adaptive Orientation 



NA 



Actlve/Reflectlvc 
Adaptive Orientation 



Test of 
Thematic 
Analysis 



Between People 
Within People 

Between Meaeuies 

Residual 



NA*- 



86 
87 



1 

86 



1.B25 

0.954 

5.885 
0.897 



6.56* 



Analysis of 
Argument^ 



Attack 



Defense 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



63 

64 



1 
63 



64 
65 



1 
64 



1.887 

2.250 

4.500 
2.214 

0.460 

0.515 

0.623 
0,514 



2.03 



1,21 



Critical 
Thinking 
Appraisal 



Inference 



Recognition 



Deduction 



Between People 
Within People 

Between Measures 

Residual 

Betwi»en People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



79 

80 



1 
79 



79 
80 



1 
79 



78 
79 



1 
78 



10.927 
5.231 

37.056 
4.828 

8.427 

3.769 

0,756 
3.807 

13.166 
5.582 
21.291 
5.381 



7.67** 



0.20 



3.96 (£ < 



Life 
History 
Exercise 



Performance 
Improvement 



NA 



,05 
.01 



^NA - not applicable - Students were not given this measure at time of first assessment. 
^Not administered to 1976 Weekday College students. 



19 7 
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Tabic P 



Sun.TTMirv for Hcpi'ntpc! Kpnnnro'i AnalysoB 
St'cond and Tlnrd Afisesflr^-pt for StuJonts in Lo^ 
Educational Acliievement Cohort 



of Variance [k'twcon 



Croup 



MS 



Measure of 
Vocational , 
Educational , 
and Personal 
Isauee 



"Beat Clasa" Easay 



"Dcclalon" Eaaay 



^Career" Eeaay 



Sentence 
Completion 
Test 



Moral Judgment 
Instruioent 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between ^Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 

Between People 
Within Petfple 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



95 
96 



I 
95 



94 
95 



1 

94 



93 
94 



1 

93 



98 
99 



I 

98 



20 
21 



1 
20 



2.266 

1.510 

3.521 
1.489 

1.892 
i.784 

17.100 
1.621 

2,357 

0.984 

0.048 
0.994 

1. 106 

0. ^90 

0.045 
0.494 

974.995 
1326.190 

4736.095 
1155.695 



2.36 



10.55** 



0.05 



0.09 



4.10 (£ < .1) 



Defining Issues Test 
PX Score 

D Score 



Test of 
Cognitive 
Development 



.Between People 
Within People 

Between Measures 

Residual 

Betyeen People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



73 
74 



1 
73 



73 
74 



1 
73 



92 
93 



1 

92 



329.312 
87.627 

264.624 
85.203 

69.155 
16.270 

0.151 
16.491 

14.067 
4.570 

0.194 
4.617 



3.11 (£ < .1) 



0.01 



0.04 



Picture 
Story 
Exercise 



Stages of Adaptation 
Receptive 



Autonomous 



Assertive 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Reaidusl 

Between People 
Within People 

Between Measures 

Residual 



100 

10 r 



1 

100 



100 

101 



1 

100 



100 
101 



1 

100 



92.967 

56.015 

67.767 
55.897 

127.466 
77.599 

17.233 
78.203 

141.550 
75.668 

42.817 
75.997 



1,21 



0.22 



0.56 



*£ < .01 



ERIC 
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^2d 



Tnb Ir P c onl imjod 



Grou£ 



df 



Picture Story 
Exercise (cont.) 

Intcgrat Lve 



Between People 
Within People 

Between Mccisures 

Residual 



100 
101 



1 

100 



12^4 239 
' . . 20b 
3^0.317 
37.457 



14. 63**-* 



Self-Dcflnltlon 



Achievement Motive 



Between People 
Within People 

Between Measurea 

Realdual 

Between People 
Within People 

Between Measurej 

Realdual 



101 
102 



1 

101 



101 

102 



1.0 1 



130. 7A2 
74.123 

105.926 
7 3.808 

125.338 
71.113 

214.123 
69.697 



1 .44 



3.07 (p < .1) 



Affiliation Motive 



Power Motive 



Between People 
Within People 

Between Measurea 

Keu Idual 

Between People 
Within People 

Between Measures 

Residual 



101 
102 



1 

101 



101 
102 



1 

101 



130.181 
71.500 
423.706 
68.013 

102.876 
89.510 
254.824 
87.873 



6.23* 



2.90 (p < 



Learning 
Style 
Inventory 



Concrete 
Experience 



Between People 
Within People 

Between Measures 

Residual 



99 
100 



1 
99 



13.558 
6.020 
13.520 
5.944 



2.27 



Reflective 
Observation 



Between People 
Within People 

Between Measures 

Residual 



9^ 
100 



I 

99 



Abstract 
Conceptuallzat Ion 



Between People 
Within People 

Between Measures 

Residual 



99 
100 



1 



17.732 
7.360 

5.120 
7.383 



0.6- 



Active 
Experimentation 



Between People 
Wlthlo People 

Between Measuret 

Residual 



) 99 
* 100 



1 
99 



16,304 
6.445 

3.645 
6;'473 



0.56 



Abstract /Concrete 



Between People 



Learning Orlentatl-^n Within People 

Between Measures 
Residual 



Actlvc/Ref Icctlve 
Learning Orientation 



Between People 
Within People 

Between Measures 

Realdual 



99 
100 



1 

99 



99 
100 



1 
99 



48.212 

21.070 

35.280 
20.926 

53.458 
18.135 

2.205 
18.296 



1.69 



0.12 



Adaptive Sryle 
Style 
Inventory 

Total Concrete 
Experience 



Between People 
Within People 

Between Measures 

Residual 



97 
98 



1 
97 



25.964 
7.6'^8 

6.985 
7.655 



0.91 



*£ < .01 
*£ < .001 
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Table P continued 



Croup 



df 



MS 



Adaptive Style 
Inventory (cont.) 

Total Reflective 
Obaervatlon 



Between People 
Wtchln ^eople 

Between Meaaurea 

Residual 



97 
96 



1 
97 



11.905 
4.388 

0.510 
4.428 



0. 12 



Total Abstract 
Conceptualization 



Between People 
Within People 

Between Meaaurea 

Residual 



97 
98 



1 

97 



18.667 
6.801 

4.291 
6.827 



0.63 



Total Active 
Experimentation 



Aba tract /Concrete 
Adaptive Orientation 



Between People 
Within People 

Between Meaaurea 

Residual 

Between People 
Within People 

Between Measures 

Residua 1 



97 

98 



1 

97 



97 

98 



1 
97 



11.327 
5.0'i6 

0.046 
5.118 

77.268 

22.327 

22.224 
22.328 



0.01 



1.00 



Active/Reflective Between People 

Adaptive Orientation Within People 

Between Measurea 
Reaidual 



97 
98 



1 
97 



34.621 
12.332 

0.862 
12.450 



0.07 



Test of 
Thenuitic 
Analysis 



Between People 
Within People 

Between Measurea 

Residua 1 



97 
98 



1 
97 



1,463 

0.801 

0.413 
0.805 



0.51 



Anslysitt of 
Argument 2 

Attack 



Defense 



Between People 
.Within People 

Between Meaaurea 
Residual 

Between People 
Within People 

Between Measures 

Residual 



93 
94 



1 
93 



89 



I 
38 



.092 
,511 
0, 
1, 



000 
527 



418 

410 
0.680 
0.407 



0,00 



1.67 



Critical 
Thinking 
Appraisal 



Inference 



Between People 
Within People 

Between Measures 

Residual 



89 
90 



I 

89 



15.258 
3.778 

0.089 
3.819 



0.02 



Recognition 



Berveen People 
Within People 

Between Measures 

Residual 



89 
90 



I 

89 



10.516 
4.122 

30,422 
3.827 



7.95* 



Deduction 



Between People 
Within People 

Between Measures 

Residual 



89 
90 



I 
89 



15.834 
4.439 

18.050 
4.286 



4.21* 



.05 
.01 



^ot administered to 1976 Weekday College students. 
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Table P continued 





Group 

Life 
HliCory 
Exercise 

Performaace BeCweerv People 

Wichin People 
Between Meatu 
Reeldual 

ImoroveiBenc BeCween People 

Wichlu People 
Between Measu 
Realdual 



df MS 



87 9b.S9(. 

88 29. 6U 

1 10.023 0.34 

87 29.839 

87 419.701 

88 505.023 

I 13.091 0.03 

87 510.677 



c 



I 




ERIC 
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Table Q 



Data Summary for Repeated Measures Analyses of Varinnco 
Kntra-re ard Second Assessment for Students in Ulijh 
Educational Achievement Cohort 



Between 



Group 



df 



MS 



Heaaure of 
Vocatlonjl, 

EduCBtlOTUbl » 

■nd Peraonal 
Icauea 



"B«it Claai'* Eaaay 



"Declilon" Essay 



"Career" Kasay 



Santence 

completion 
Teat 



Moral Judgment 
laeCruoianr 



Between People 
Within People 

Betveen Meaaurea 

Realdual 

Between People 
Wlthtn People 

Between Meaaurea 

Realdual 

Betwfcen People 
Within People 

Between Meaaur«a 

Realdual 

Between People 
Within People 

Between Meaaurea 

Realdual 

Between People ^ 
Within People 

Betveen Meaiurea 

Realdual 



lOZ 
103 



I 

102 \ 



103 

104 



I 

103 



92 
93 



I 
92 



105 
106 



105 



28 
29 



I 

28 



2.25? 
0.976 

■ 1.092 
0.975 

1.981 

0.885 

1.923 
0.875 

2.010 

0.9U 

0.774 
0.916 

1.169 

0.646 

0.005 
0.652 

1722.701 
820.862 

216.276 
842.454 



1.12 



2.20 



0.85 



O.Ol 



0.26 



Defining laaues Teat 
FX Score 

D Score 



Teat of 

Cognitive 
Development 



Betveen People 
Within People 

Betveen Masaurea 

Residual 

Between People 
Within People ' 

Betveen Meaaurea 

Realdual 

Betveen People 
Within People 

Betveen Meaaurea 

Realdual 



70 
71 



1 
70 



70 
71 



1 
70 



102 
103 



I 

102 



305.224 
128.906 

3116.135 ^ 
86.231 ' 

75.058 
19,875 
173.025 
17.687 

14.933 
5,286 

73.442 
4.618 



36.14*** 



9.78** 



15.90*** 



Picture 
Story 
Xxerclae 



Stagea of Adaptation 
Racaptlve 



Autonomoua 



Aaaertlve 



Between People ^ 
Within People 

Between Meaaurea 

Realdual 

Between People 
Within People 

Betveen Meaaurea 

Realdual 

Between People 
Within People 

Between Meaaurea 

Realdual 



106 

107 



1 

106 



106 
107 



1 

106 



106 
107 



«i 106 



112.205 

lOr 285 

271,407 
101,699 

106.902 
76.603 

57,575 
76,782 

117.393 
69,467 
366,355 
66,666 



2.67 



0.75 



5,50^* 



**£ < ,01 
***£ ^ .001 



202 



Table Q continued 



Group 



df 



MS 



Picture Story 
Ex«rciae (cone.) 

Integrative 



S«U'D«flaltloo 



Achievement Motive 



Affiliation Motive 



Power Motive 



Between People 
Within People 

Between Measures 

Residual 

Betveen People 
Within People 

Between Measures 

Residual 

Betveen People 
Within People 

Betveen Measurea 

Residual 

Betveen People 
Within People 

Betveen Measures 

Residual 

Betveen People 
Within People 

Between Measures 

Residual 



106 
107 



1 

106 



106 
107 



1 

106 



106 
107 



1 

106 



106 
107 



1 

106 



106 

107 



1 

106 



115.503 
72.047 

22.897 
72.510 

121. 100 
69.248 
192.565 
68.084 

134.523 
97.565 

149.724 
97.073 

117.506 
73.154 

75.369 
73.133 

124.040 
74.486 
437.551 
71.061 



0.32 



2.83 (£ < . 1) 



1.54 



1.03 



6. 16* 



Learning 
Style 
Inventory 



Concrete 
Experience 



Reflective 
Observation 



Abstract 
Conceptual Ization 



Active 
Experlnentation 



Between People 
Within People 

Between Measures 

Residual 

Betveen People 
Within People 

Between Measurea 

Reaidual 

Between People 
Within People 

Between Meaauraa 

Reaidual 

Betveen People 
Within People 

Betveen Meaauraa 

Reaidual 



107 

108 



1 

107 



107 
108 



1 

107 



107 

108 



I 

107 



107 
108 



1 

107 



11.390 
4.866 

22,042 
4.705 

14. 230 
11.079 
301.042 
8,369 

16,550 
9,213 
294.000 
6.551 

11.877 
5.907 

0,6^7 
5.956 



4,68* 



35. 97**^* 



44.88*** 



0. 11 



Abatract/Concrete 
Learning Orientation 



Betveen People 
Within People 

Between Meaauraa 

Reaidual 



107 

108 



I 

10/ 



42.176 
20,264 
477.042 
15.995 



29.82*** 



Active/Reflective 
Learning Orientation 



Betveen People 
Within People 

Between Measurea 

Reaidual 



107 

loa 



1 

107 



41.698 
22. 792 

330.042 
19.920 



16. 57*** 



Adaptive Ctyle 
Swyle 
Inventory 



Total Concrate 
Exper lance 



NA" 



*-**j» < .001 



*NA 



ti')t flppl Icfibli' • :^;tudiM){ fl wert- not. Kivi-ii thU mcflfivirr nt t ime oi tlr«r aHHt-fiHiM-nt . 
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Table Q continued 



Group 



d£ 



MS 



Adaptive Style 
Inventory (cont.) 

Total Reflective 
Observation 



NA 



Total Abatract 

Conceptualisation 



NA' 



Total Active 
Experlaientatlon 

Abstract/Concrete 
Adaptive Orientation 

Active /Reflective 
Adaptive Orientation 



Test of 
Thematic 
Analysis 



Between People 
Within People 

Between Meaaurea 

Residual 



NA 



NA 



NA 



106 
107 



I 

106 



1.232 

1.075 

0.000 
1.085 



0.00 



Analysis of 
Argument 



Attack 



Defense 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



68 

69 



I 

68 



66 
67 



I 

66 



2.3A7 

1.500 

0.065 
1.521 

0.627 

0.A33 

0.030 
0.A39 



O.OA 



0.07 



Critical 
Thinking 
Appraisal 



Inference 



Recognition 



Deduction 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual' 

Between People 
Within People 

Between Measures 

Residual 



lOl 

102 



I 

10 1 



lOl 
102 



I 

lOl 



lOl 
102 



I 

lOl 



15.61A 
4.853 

A.A12 
A. 857 

9.116 

A. 270 

3. 06 A 
A. '.82 

17.987 
5.059 

7.8A3 
5.031 



0.91 



p. 72 



1.56 



Life 
History 
Exercise 



Perfomiancc 
IraprovanMnt 



NA 



NA 



^NA - not applicable - Students were not given this measure at time of first assessment. 
^Not administered to 1976 Weekday College students. 
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Tabu* R 



Data Summary for Repeated Measures Analyses of Variance Hetween 
Second and Third Assessment for Students In High 
Eclucationul Achievement Cohort 



Group 



df 



MS 



Measure of 
Vocational* 
Educational, 
and Peraonal 
laauea 



"Beat Claaa" Eaaay 



"Declalon" Eiiay 



"Career" Eaaay 



Sentence 
Completion 
Teat 



Moral Judgment 
In8trunj*int 



Between People 
Within People 

Between Meaiurei 

Residual 

Between People 
Within People 

Between Meaeuree 

Reaidual 

Between People 
Within People 

Between Meaeuree 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Residual 



99 
100 



I 
99 



99 
100 



1 
99 



97 
98 



I 

97 



99 
100 



I 

99 



21 

22 



I 

21 



2.079 

1.555 

6.125 
1.509 

2.432 

1.480 

4.500 
1.449 

2.155 

1.286 

0.18A 
1.297 

1.847 

0.515 

0.405 
0.516 

2985.845 
866.795 

164.205 
900.252 



4,06* 



3.10 (z < -lO) 



0.14 



0.78 



0.18 



Defining issues Teat 
P% Score 

D Score 



Teat of 

Cognitive 
Development 



Between People 
Within People 

Between Measures 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Reaidual 



65 

66 



I 

65 



65 

66 



97 
98 



I 

97 



296.681 
88.051 

154.267 
87.032 

73.501 

15.501 

52.065 
14.938 

17.223 
4.418 

1.653 
4.447 



1.77 



3.49 (£ -I) 



0.37 



Picture 
Story 
Exercise 



Stages of Ailnptntlmi 
Receptive 



Autonoraoua 



Aaaertlve 



Bet»icen People 
Within People 

BN'tween Meaaurea 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Reaidual 



97 



I 

96 



96 
97 



1 

96 



96 

K7 



I 

96 



107,668 

104.490 

460.830 
100.778 

109. 116 
86.165 

9.093 
86,968 

86.191 

82. 304 

403.521 
78.677 



0. 10 



5.4;* 



»r*£ ^ ,01 
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Table P continued 



Group 



df 



MS 



Picture Story 
Exercise (cont.) 

Integrative 



Self-Defiaitioa 



Achievement Motive 



Between People 
Within People 

Between Meaaurea 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Reaidual 



96 
97 



1 
96 



96 
97 



1 
96 



96 
97 



1 
96 



114.993 
62.072 

645.959 
55.990 

120.403 
92.206 
653.278 
86.362 

109.333 
78.541 
531.139 
73.827 



11.54*** 



7.56*^ 



7.19** 



Affiliation Motive 



Power Motive 



Between People 
Within People 

Bet%reen Meaaurea 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Reaidual 



96 

97 



1 
96 



96 
97 



1 
96 



116.020 
86.273 
270.314 
84.356 

93.168 

65.887 

69.361 
65.850 



3.20 (£ < .1) 



1.05 



Learning 
Style 
Inventory 



Concrete 
Experience 



Reflective 
Obaervation 



Abstract 
Concep tua 1 iza t ion 



Active 
Experinentation 



Between People 
Within People 

Between Meaaurea 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Reaidual 

Between People 
Within People 

Between Meaaurea 

Reaidual 

Between People 
Within People 

Bet%reen Meaaurea 

Reaidual 



Abatract/Concrete Between People 

Learning Orientation Within People 

Between Meaaurea 
Reaidual 

Active/Reflective Between People 

Learning Orientation Within People 

Between Meaaurea 
Reaidual 



101 

102 



I 

lOl 



101 
102 



1 

101 



101 
102 



1 

101 



101 

102 



I 

101 



101 
102 



1 

101 



101 
102 



I 

101 



12.687 
5.750 

5.338 
5.754 

19.579 
5.721 

0.593 
5.771 

14.946 
8.627 

4.412 
8.669 

16.387 
3.377 

12.750 
3.285 

42.S91 
21.2^9 

0.044 
21.509 

58. 180 

12.843 

18.843 
12.784 



0.93 



O.IO 



0.51 



3.88 (£ - .1) 



0.00 



1.47 



Adaptive Style 
Style 
Inventory 

Total Concrete 
Experience 



Between People 
Within People 

Betwean Meaaurea 

Raaidual 



100 
lOl 



I 

100 



26. 115 
7.965 

2.183 
8.023 



0.27 



^£ 4 .05 

**£ / .01 



EKLC 
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Table 



continued 



Group 



df 



MS 



Adaptive Style 
Inventory (cont.) 

Total Reflective 
Observation 



Total Abstract 
Coaceptuallxatlon 



Between People 
Wltnin People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Resldusl 



100 
101 



1 

100 



100 
101 



1 

100 



14.029 

•5.748 

0.045 
5.805 

19.251 
6.243 

1.431 
6.291 



0.01 



0.23 



Total Active 
Experimentation 



Abstract/Concrete 
Adaptive Orientation 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



100 
101 



1 

100 



100 
101 



10 



12.611 
4.099 

0.317 
4.137 

78.456 
21.743 

7.149 
21.889 



0.08 



0.33 



Active/Reflective 
Adaptive Orientation 



Teat of 
Thematic 
Analysis 



Between People 
Within People 

Between Measures 

Residual 

Between People 
Within People 

Between Measures 

Residual 



100 
101 



1 

100 



95 
96 



1 
95 



40.970 
13.054 

0.599 
13.179 

1.416 

0.953 

0.255 
0.960 



0.05 



0.27 



Analysis of 
Argument* 

Attack 



Def enae 



Between People 
Within People 

Between Measures 

Residual 

Beti^een People 
Within People 

Between Measures 

Residual 



94 

95 



1 

94 



89 
90 



1 

89 



1.647 
1.616 

1. 
1. 



QOO 
013 



0.576 

0.478 

0.800 
0.474 



1.18 



1.69 



Critical 
Thinking 
Appraissl 



Inference 



Between People 
• Within People 

Between Messures 
Residual 



91 
92 



1 
91 



12.853 
4.788 

24.397 
4.573 



5. 34* 



Recognition 



Between People 
Within People 

Between Measures 

Resldusl 



91 
92 



1 
91 



9.434 
3.875 

12.005 
3.786 



3. 17 (p. < . 1) 



Deduction 



Between People 
Within People 

Between Measures 

Resldusl 



91 
92 



1 
91 



15.830 
15 3 
7.440 
4.319 



1.72 



*£ /. .05 



Not administered to 1976 Weekday Culle«o otudonta 
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Table K continued 



Croup 



df 



MS 



History 



Performance 



Improveaent 



Between People 
Within People 

Between Meeauree 

Residual 

Between ?eople 
Within Pfeople 

Between Messures 

Residual 



95 
96 



I 
95 



95 
96 



I 
95 



66.414 

37.375 

27 . 000 
3V. W 

561.936 

480.500 

927.521 
475.795 



0.72 



1.95 
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Table S 



Multiple Correlations Betwet^n Entrance ^1Q*^ssfK!nt^; aoj 
Student Bacigiroiind Variabie** 



5 ^ 



-4 O K I 



U w 

5^ 



Measure of 
VoC9t lonnl . 
Educational^ 
and Personal 
Isauea 

Sentence 
. Complet ion 
Teat 

Moral 
Judgment 
Itist ruroent 

Duf Inln^ 
Issuetf 
Test 

Teat of 
Cognlt Ive 
Oevelopmunt 

Picture 
Story 
Exerc i3<' 



Learning 
StyU- 
Inventory 



Adapt ivi* 
Style 
Invfutory 



Tei,t of 
Thi'nuit ic 
Analysis 

Analy^iB 
of 

Argument 

LtiticAl 
ThinkinK 
Appra isnl 

Life 
History 
Exerc i»e 



"Best Class" Essay 
"Decision" Essay 
"Career" Essay 



PZ Gcorc 
D Score 



Stages of AdajJtation 
Recept ive 
Autonomoua 
Assert ive 
Inte^rnt ive 

Self ~Def inition 

Achievement Motive 
Affiliacion Motive 
Power Mottve 

Concrete Expcriencu 
Reflective Observation 
Abstract Conceptual ii.ctioit 
Active Experimt.ntation 



196 
197 
180 

199 



UO 
UO 



.045 
.221 
. 226* 



.106 
.105 
.100 



.112 
.142 
.050 

.047 



.136 .249 



.017 .065 



.127 
.114 
.081 



.113 
.203 
.180 



.118 
.2 34 
.182 

.198 



.224 .283 



.129 
.170 
.100 

.086 



.125 
.278 
. 302* 



.139 
.096 
.198* 

.0t)8 



.2:'l .?28 



.148 .212 



.245 .082 .133 .1^9 



.225 



.179 
.158 



.14 3 -176 
.169 .110 .110 



.037 .070 



.12? .150 .106 



.167 .31-3 



.099 .121 



166 
166 
If 6 
166 


.088 

. ^28 
.U9 


.004 

.235 
.103 


.220 
.171 
.1J8 
.1/6 


.200 
.203 
.025 
.188 


.154 
.211 
.083 
.127 


.126 
.'Alb 
.113 
.092 


.076 
.103 
.176 
.133 


.153 

.263 
.139 


.151 
.137 
.172 

029 


}.bfi 


** 

.232 


.183* 


* 

.246 


.163 


»207 


.059 


.069 


.226 


.196* 


lf.fi 
166 
166 


.102 
.004 
,103 


.04 / 
.020 
.136 


. i:i2 
.208 
.118 


.088 
.146 
.079 


.136 
.132 
.105 


.221 
. 209 
. 128 


.166 
.178 
.150 


.072 
.068 
.118 


.182 
.060 
.116 



202 
202 

202 



.?95 
.100^ 
.205 
,078 



.079 


.160 


.197 


.168 


.111, 


.046 


.175, 


.136 


.158 


.163 


.220 


.14 5 


.064 


.1j3 


.187 


.172 



.151 
.119 
.095 
.053 



.132 
.105 
.097 
. 166 



.126 
.015 
.128 
.070 



.142 
.038 
.121 
.027 



Abstract/Concrete 


202 


** 

.245 


* 

.149 


.166 


.215 


.179 


.119 


.098 


.149 


.149 


Learning Orientation 






















Active/Reflective 


202 


.104 


.104 


.085 


.196 


.155 


.066 


.09 3 


.038 


.cl^ 


Learning Orientation 






















Total Concrete Experience 
Total Reflective Observation 
Total Abstract Conceptualization 
Total Active Experimentation 


199 
199 
195 
199 


.113 
.06/ 
.006,^ 
.209 


.02 5 
.OH 9 
.080 
.02'* 


.158 
.133 
.181 
.109 


.082 
.146 
.116 
.17/ 


.160 
.062 
.180 
.184 


.133 
,147 
.134 
.096 


.058 
.171 
.080 
.226 


.131 
.089 
.171 
.038 


.157, 
.195 
.110 
.147 


Abstract/Concrete 


199 


.068 


.055 


.179 


.081 


.169 


.124 


.0(.4 


.156 


.147 


Adaptive Orientation 




















* 


Act Ive/Kuf lect ive 


199 


.156* 


.010 


. 129 


.163 


.121 


.104 


.226 


.046 


.195 


Adaptive Orientation 








































* 


** 






* 

.167 


.02 5 


.142 


* 

.2j9 


.040 


.097 


.125 




.265 


Ar tnck 


132 


.071 


.080 


.205 


.140 


,0H1 


.025 


.204 


.05fl 


. 171 


Defense 


132 


. If 1 


108 


.153 


.206 


.184 


.163 


.202 


.114 


.161 


Inf urence 
Recognition 

Deduction 


U.2 
182 
182 


.114 
.119 
.002 


.04/. 
.088 
. 104 


.106 
.113 
.126 


.184 
. 216 
. 190 


.093 
.181 
.112 


.164 
.099 
.125 


. 254*, 
. 322, 
.232 


.134 
.114 
.076 


.162 

.lAO 
.079 


Pcrf onnancr 


IHA 


.Of>4 


.016 


.176 


• / 


.211 


.107 


** 

.314 


. U)S 


.041 


Improvement 


1B4 


.01/. 


.100 


.n«:j 


.176 


. 1 34 


.137 


.122 


.05 J 


. fJS8 
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Table T 



Data Summary for t Tests of Mean Differences Between All Levels 
of Student Background Variables Significantly Corrolated 
With Entrance Assessments 



Index 



Background 
Variable n M 



Measure of Vocational, Educational, and Personal Issues 



"Best Class" Essay 

Prior College Experience 



1-12 Credits 
13+ Credits 
No Prior 



21 
46 
129 



2.86 
3.59 
2. 94 



1.87 
0.30 



3. 29** 



EKLC 



"Decisior." Essay 
Religion 



1. Catholic 


127 


3.50 










2. Non Catholic 


70 


3.16 


2. 


00* 






Father's Occupation 














1. Level 1 


61 


3.30 










2. Level 2 


35 


3.40 


0. 


43 






3. Level 3 


67 


3.25 


0. 


20 


0. 


61 


4. Level 5 




3.93 


1. 


75 


1. 


46 2.01* 


5. Missing Data 


20 


2.65 


2. 


20* 


2. 


35* 2.08* 


Marital Status 














1. Married 


38 


3.63 










2 . Divorced/Widowed 


15 


4J4 


1. 


.47 






3. Single 


144 


3.10 


2. 


.62** 


3. 


,41** 


"Career" Essay 














Prior College Experience 














1. 1-12 Credits 


19 


3.37 










2. 13+ Credits 


44 


3.32 


0 


.15 






3. No Prior 


117 


2.84 


1 


.81 


2 


.30* 


Marital Status 














I. Married 


37 


3.54 










2 . Divorced/Widowed 


15 


3.67 


0 


.36 






3. Single 


128 


2,78 


3 


.53** 


2 


.82** 



3.22** 



*£ < .05 

**A£ < .01 
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Table T continued 



Index 



fiackground 
Variable 



High School CPA 



"D" Average 
"C" Average 
Average 
Average 
Missing Data 



"B" 
"A" 



Paired Comparison 
t 



Test of Cognitive Development 



4 
29 
99 
33 
26 



7.00 
11.24 
11.38 
13.21 
10.38 



2.45* 

2.64** 0.21 

3.61** 2.38* 2.80** 

1.94 0.98 1.40 



3.33** 



1. 1-12 Credits 

2. 13+ Credits 

3. No Prior 

Self-Uef init ion 
Religion 

1. Catholic 

2. Non Catholic 

Mother's Education 



Picture Story Exercise 



Stages of Adaptation 

Assertive 

Religion 

!. Cdtholic 

2. NoQ Catholic 

Prior College ExperLt-iice 



L29 
70 



21 
44 
13^ 



130 

69 



49.93 
46.04 



46.00 
45.61 
49.93 



49.67 
46. 13 



2.93^"* 



0. 16 
1.87 



2.5b* 



2.78>^* 



1 . 


Primary 


40 


48. 13 








2. 


High School 


88 


47.06 


0.60 






3. 


Post High School 


28 


53. 18 


2.21* 


3.04** 




4. 


CTroduate 


23 


50.57 


1.32 


1.64 


1.0a 


5. 


Missing Data 


20 


4 5.90 


0.88 


0.50 


2.68** 



Prior College Experience 

1. 1-12 Credits 21 46.76 

2. 13+ Credits 44 45. 11 

3. No Prior I '34 49.77 



0.68 
1 .38 



1.65 



.05 



211. 



24i 



Table T continued 



Index 

Background 
Variable 



Picture Story Exercise (continued) 



Marital Status 



EKLC 



1. Married 39 

2 . Divorced/Widowed 15 

3. Single 



A7.36 
A6.20 
A9.52 



0.A2 
1.31 



2.56* 



Learning Style Inventory 



Abstract Conceptualization 
Religion 

1. Catholic 

2. Non Catholic 

Father's Education 

1. Primary 

2. High School 

3- Post High School 

A. Graduate 

5. Missing Data 

Abstract /Concrete 
Learning Orientation 

Religion 



132 



15.37 



70 


lA. 


27 


2. 


26* 










A3 


lA, 


.09 














68 


15. 


.8A 


0. 


.59 










35 


15, 


,17 


0. 


.31 


0. 


.21 






28 


lA, 


. 10 


0. 


.00 


0. 


,51 


0, 


.28 


2B 


15 


.00 


1 


. 13 


1 , 


. 12 


0, 


.20 



1.02 



1 . Catholic 

2 . Non Catholic 


132 
70 


-O.AA 
-2.00 


2.13* 








Adaptive Style 


Learning 






Total Reflective Observation 












Marital Status 












1 . Married 

2. Divorced/Widowed 

3. Single 


15 
AO 
lAA 


16.20 
13.65 
1A.15 


2.75** 
2.A7* 0. 


92 




Active/Reflective 
Adaptive Orientation 












Marital Status 












1. Married 

2. Divorced/Widowed 

3. Single 


15 
20 
16A 


6,93 
2.55 
3.78 


2.A6* 
2.23* 1 


.33 




*£ < .05 
**£ < .01 




212 









242 



Table T continued 



Index 



Background 
Variable 



Test of Thematic Analysis 



Father's Education 



K 


Primary 


AO 


1. 


62 


1. 


56 






2. 


High School 


67 


1. 


27 




51* 


3. 


Post High School 


33 


1. 


88 


0. 


9A 


2. 


A. 


Graduate 


28 


1,07 


1. 


96 


0. 


77 1.92 


5. 


Missing Data 


26 


1. 


19 


1. 


51 


0. 


29 2.29* 


Prior Coliege Experience 
















1, 


1-12 Credits 


21 


1. 


,71 








i' 


2 . 


13+ Credits 


A2 


1. 


,74 


0. 


,08 






3. 


No Prior 


131 


1. 


,25 


1, 


.72 


2. 


,39* 


Marital 


Status 
















1. 


Married 




1 


.75 










2. 


Divorced /Widowed 




2 


.31 


1 


.54 






3, 


Single 


IA6 


1 


.25 


2 


.34* 


3 


.25** 



0.39 



Analysis of Argument 



Defense 

Marital Status 



1 . Married 

2 . Divorced/Widowed 

3. Single 



13 

33 
138 



1.92 
1.48 

"1 . 84 



1.80 
0.38 



2.47* 



Critical Thinking Appraisal 



Inference 

High School CPA 



'D" Average / 



I, 
2. 

3. "B" Average 

4. "A" Average 

5. Missing Data 



3 


7. 


,33 












26 


9. 


,07 


0. 


.95 








94 


9. 


,03 


0. 


.96 


0.07 






33 


10- 


,97 


2. 


,00* 


2.40* 


3. 


,18** 


26 


9. 


,19 


I, 


.01 


0. 14 


0. 


,24 



2.26 



**£ < 



.05 
,01 
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Table T continued 



Index 



Background 
Variable 



M 



Critical Thinking Appraisal (continued) 



Recognition 

High School GPA 



1. 
2. 
3. 
A. 
5. 



"D" Average 
"C" Average 
"B" Average 
"A" Average 
Missing Data 



3 


11. 


,67 








26 


10. 


,89 


0. 


53 




94 


10. 


.52 


0. 


81 


.68 


33 


12. 


.70 


0. 


,71 


2.87** 


26 


11, 


.31 


0. 


,24 


.63 



1 



4.46** 
1.48 



2.20* 



Deduction 



Hi<-;. School GPA 

1. "D" Average 

2. "C" Average 
"B" Average 

4. "A" Average 

5. Missing Data 



Performance 

High School GPA 



1. 
2. 
3. 
4. 

5. 



"D" 



Average 
Average 
Average 
Average 
Missing Data 



*£ 



,05 
.01 



3 


15. 


,34 










26 


15. 


,73 


0. 


21 






94 


15. 


.83 


0. 


27 


0. 


14 


33 


17, 


.67 


1. 


,22 


2. 


,33* 


26 


15 


.58 


0. 


.13 


0. 


,18 



Life History Exercise 



3 


58. 


67 








26 


59. 


,12 


0.11 






97 


59. 


.37 


0.18 


0. 


17 


33 


63, 


.30 


1.13 


2. 


,34 


25 


64 


.88 


1.49 


3. 


.02* 



2.87** 
0.36 



2.53* 



2.86* 
3.61** 



0.87 
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Table U 

Squared Part Correlations of Categorical Variables With 
Entrance Assessments With Age Controlled 



Index 

Background 
Variable 


Cumulative 


Increment 
in) r2 


F 


Measure of Vocational, Educational and 


Personal Issues 




^'Decision" Essay 
Age 

Religion 


.049 
.061 


.012 


2.48 


Age 

Father's Occupation 


.049 
.091 


.042 


2.21 


Marital Status 


.049 
.083 




3.58* 


"Career" Essay 
Aee 

Prior College Experience 


.051 
.063 


. j12 


1.13 


Age 

Mar^ta^ Status 


.051 
.093 


.04 2 


4.08* 


Picture 


Story Exercise 






Stages of Adaptation 
Assertive 

Age « 
Religion 


.032 
.063 


.031 


- 

6.49* 


Age, 

Religion 

Prior College Experience 


.063 
. u / y 


.016 


1.69 


Self-Definition 
Age 

Religion 


.056 
.075 


.019' 


4.03 * 


Age 

Mother's Education 


.056 
.113 


.057 


3.10* 


Age, 

Mother's Education 
Prior College Experience 


.]13 
.127 


.014 


1.53 


Age, 

: Mother's Education 
Marital Status 


.113 
.114 


.001 


0.11 



ERIC / 



Table U continued 



Index ^ , ^. 
^ , 1 Cumulative 
Background 2 

Variable - 


Increment 
in 


F 


Learning Style Inventory 


Abstract Conceptualization 

058 

Religion . • 


.016 


3.38 


^ Age -0^2 
Father's Education -077 


.035 


1.86 


Abstract/Concrete Learning Orientation 

Age -^^5 
Religion -^^^ 


.012 


2.57 


Adaptive Style Inventory 


Active/Reflective Adaptive Orientation 

Age -024 
Marital Status -077 


.053 


5.60** 


Test of Thematic Analysis 


Father ' s Education -u/o 


.048 


2.44 * 


Father's Education -u/o 
Prior College Exp-erience -090 


.014 


1.43 


Age, 

rather' s Education -O^O 
Marital Status .121 


.031 


3.28- 


Analysis of Argument 






Age- " .022 
Marital Status .041 


.019 


1.80 



* p < .05 
** p < ,01 
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Table V 

Correlations Between Asseeumcnts for Each 



Measure 



Co rrelatlon 
Second with First 



Correlation 
Third with Second 



Measure of 
Vocat lonal , 
Educational ► 
and Personal 
Issues 

Sentence 
Completion 
Test 

Moral .ludp,mcnt 
InRt rumen 

Defining 
Issues 
Test 

Teat of 
Cognitive 
Development 

Picture 
Story 
Exercise 



Learning 
Style 
Inventory 



Adapt Ive 
Style 
Inventory^ 



Test of 
Thematic 
Analysis 

Analysis 

of 

Argument 

Critical 
Thinking 
Appraisal 

Life 
History 
ExercUe 



"Beat Class" EBsay 
"Decision" Essay 
"Career" Essay 



PX Score 
D Score 



Stages of Adaptation 
Receptive 
Autonomous 
Assert Ivc 
Integrative 

Self-Definition 

Achievement Motive 
Affiliation Motive 
Power Motive 

Concrete Experience 
Reflective Observe*- ion 
Abstract Conceptualisation 
Active Experimentation 

Abstract/ Concrete 
Learning Orientation 

Active/Reflective 
Learning Orientation 

Total Concrete Experience 
Total Reflective Observation 
Total Abstract Conceptualization 
Total Active Experimentation 

Abstract/concrete 
Adaptive Orientation 

. Act ive/ Reflective 

Adaptive Orientation 



Attack 

Defense 

Inference 

Recognition 

Deduction 

Performance 

Improvement 



.33: 


.134 


.272 


. i lb 


.320 


.332 


. 359 


.492 


.486 




. 518 


. JoU 


.649 


.64 3 


.A77 

• 


.552 




( . 1 30) 


.149 


.178 


.251 


. 194 


.134 


. 357 


.297 


.204 


. 148 


.248 


. 183 


.242 


.226 


(.121) 


. 249 


. 391 


.311 


.523 


.380 


.341 


.405 


. 548 


.342 


.366 


.429 


.572 




.540 




.435 




.486 




.451 




.559 




.499 



.204 

(.085) 
(.046) 

.483 
.366 
.510 

.480 

(>113) 



^hls Instrument was not given at time of first assessment. 
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.241 

(.149) 
(.087) 

.541 
.452 
.576 

.414 

(.002) 



Table W 



Squared Part Correlations of Student Background Variables 
With Second Assessments With First 
Assessment Controlled 



^^^^^ Cumulative 
Background 2 

Variable ^ 


Increment 
in r2 


p 


Measure of Vocational, Educational ano Personal 


Issues 




''Best Class" Essay 






First Assessment .110 
Pr-fnr Collece Exoerience .151 


.041 


4.61* 


"Decieion" Essay 






First Assessment .074 
Age -112 
Marital Status -126 


.038 
.014 


8.22** 
0.75 


^'Career" Essay 






First Assessment .103 
Age -118 


.015 


2.93 


First Assessment .103 
Marital Status -126 


.023 


1.11 


Moral Judgment Instrument 


First Assessment • 236 
Age -241 


.005 


0.26 


Defining Issues Test 


D Score 






1st Assessment .421 
Age ^ -^^1 


.020 


4.90* 


Test of Cognitive Development 


First Assessment • 227 
Grade Point Average .?70 


.0^3 


2. 72* 


Picture Story Exercise 


Stages of Adaptation 






Assertive 






First Assessment -063 
Age -064 


.001 


0. 21 


First Assessment .063 
Religion -063 


.000 


0.00 


Self-Definition 






First Assessment -042 
Age -0^3 


.001 


0.21 


First Assessment .042 
Mother's Education -069 


.027 


1.40 



< .05 

£ < .01 
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Table W continued 



Index Cumulative Increment 
Background 2 in 
Variable . - 



Learning Style Inventory 



Concrete Experience 

First Assessment -062 

Age -064 .002 0.A3 

Abstract Conceptualization 

First Assessment -1^^ m 

Age -189 -045 11.0A*>^ 

Abstract/Concrete Learning Orientation 

First Assessment , o^** 

Age -138 .021 4.87** 

Test of Thematic Analysis 



First Ass2ssment 
Age 


.041 
.057 


.016 


3. 


24 


First Assessment 
Father* s Education 


.041 
.057 


.016 


0. 


80 


First Assessment 
Marital Status 


,041 
.099 


.058 


3. 


03* 


Critical Thinking Appraisal 


Inference 

First Assessment 
Grade Point Average 


.232 
,254 


.022 


1. 


.30 


Recognition 

First Assessment 
GiTade Point Average 


.140 
.173 


.033 


1, 


.76 


Deduction 

First Assessment 

First Assessment, Quadratic 

Grade Point Average 


.260 
.306 
.350 


,046 
.044 


11 
2 


,80** 
.95* 


Life History 


Exercise 








Performance 

First Assessment 
Grade Point Average 


.230 
.271 


.041 


0 


.72 



*2 < .05 
**£ < .01 
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Table X 



Squared Part Correlations of Student Background 
With Third Assessments With Second 
Assessment Controlled 



Index 

Background 
Variable 


Cumulative 
R 


Increment 
in 




F 


Measure of Vocational, Educational 


, and Personal 


Issues 






"Best Class" Essay 

Second Assessment 

Prior College Experience 

"Decision" Essay 

Second Assessment 
Age 


.034 
.036 

.031 
.031 


.002 
.000 


0. 

0. 


22 

00 


Second Assessment 
Marital Status 
"Career" Essay 

Second Assessment 

Second Assessment, Quadratic 

Age 


.110 
.137 
.138 


.027 
.001 


5 

0. 


.38* 

.20 


Second Assessment 

Second Assessment, Quadratic 

Marital Status 


.137 
.169 


.032 


1 


.62 


Moral Judement Instrument 


Second Assessment 
Age 


.146 
.209 


.063 


3 


.19 


Defining Issues 


Test 









ERIC 



D Score 

Second Assessment -^j-^ ^ 234 

Age 



Test of Cognitive Development 



Picture Story Exercise 



Assertive 



Second Assessment -0^2 ^^^^ 



Self-Definition 
Sec 
Age 

Sec 

Mother's Education 



*£ <\.05 
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Second Assessment -305 ^ 

Second Assessment, Quadratic .^^b • ^^37 

Grade Point Average • 



Second Assessment -038 ^ 

Second Assessment, Quadratic .060 • uzz • 

HAA .006 i.ZD 

Age 



Second Assessment -0^2 ^^^^ 



.043 .001 
.042 

.069 .027 



Table X continued 





Index 


Cumulative 


lu^rement 




Bcickgroiind 
Variable 




in 


F 


Learning Style 


Inventory 






Concrete Experience 


.153 






Second Assessment 




0.17 


Age 




. 001 


Abstract Conceptualization 


■ X X u 






Second Assessment 




4. 37* 


Second Assessment Quadratic 


. 1 J D 


. 019 


Age 


. 136 


. UUl 


0.23 


Abstract/concrete Learning Orientation 








Second Assessment 




0.23 


ARe 


. 135 


. UUl 


AaapLive Dcyxe 


XLIV CLILU L jr 






Total Reflective Observation 








Second Assessment 


.189 




2.97* 


Marital Status 


.236 


.047 


Total Active Experimentation 








Second Assessment 


.203 




0.49 


Age 


.205 


.002 . 


Active/Reflective Adaptive Orientation 








Second Assessment 


.249 




1.58 


Age 


.255 


.006 


Second Assessment 


.249 




3.29* 


Marital Status 


.297 


.048 


Test of Thematic Analysis 


Second Assessment 


.058 




3.51 


Age 


.075 


.017 


Second Assessment 


.058 




1.18 


Father's Education 


.081 


.023 


Second Assessment 


.058 






Marital Status 


.077 


.019 


0.97 


Critical Thinking Appraisal 


Inference 








Second Assessment 


.251 




1.39 


Grade Point Average 


.274 


.023 


Recognition 


.204 






Second Assessment 




10.98* 


Second Assessment, Quadratic 


.205 


.046 


Grade Point Average 


• 274 


.024 


1.45 


Deduccion 








Second Assessment 


.335 




1.36 


Grade Point Average 


.355 


.020 


Life History 


Exercise 






Performance 


.172 






Second Assessment 


.318 


0.99 


Grade Point Average 


.190 



*£ < .05 

**£ < .01 
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Tnble Y 



Squared Part Correlatlone of Collese ProKram VarlabloH With 
'second ABsessT^ntB Controlling for Background 
Covnrlates and First AssessTnontfl 



Measurer 



nt 


o 










'J) 












U f. 


0} 






< 


C 







Program Covarlates 



c 3 

01 w 



Measure cf Vocational » Educational, and Personal Iseiues 



"Be«t Class" Essay 
"Decision" Essay 
"Career" Essay 



D Scor*.- 



Stagefl of Adaptation 
Recept Ive 
Autonomous 
Assert ive 
Integrative 

Self-Def ipitlon 

Achievement Motive 
Aff illation Motive 
Power Motive 



Concrete Experience 
Reflective Observation 
Abstract Conceptualization 
Active Experimentation 

Abstract/Concrete 

Learning Orientation 

Act i'fe/Reflectlve 

Learning Orientation 



Inference 
Recognit Ion 
Deduct ion 



Performance 
Improvement 



*£ < .05 
**£ < .01 



li.O 
7.4 
10.3 



Prior Col. 
Age 



Exp. 



4.1 
3.8 



.039* 
.002 
( .032*) 



.019 
.007 
.011 



. 008 . 04 5 
.070** .019 
0 .105* 



Sentence Completion Test 



12.9 



.044** .008 



.027 



.033 



Moral -.udk^ment Instrument 



23.6 



.091 .003 



.007 



Defining Issues Test 



26.8 
42. J 



Age 



.001 .027 .022 
2.0 .003 .010 .012 



.059 
.040 



Test of Cognitivo Development 



22.7 



Grade Point Avg. 4.3 .009 -004 .007 



.030 



Picture Story Exercise 



XXX 

2.2 
h.3 
2.4 

B.8 

2.2 
3.4 
5.1 











.013 


.014 


031 


.020 


.014 


.005 


005 


.029 


.037* 


.024 ( 


040*) 


.04 0 


.024 


.031 


.001 


.n2a 


.009 


.014 


.012 


.058 


.107** 


(.057**) 


.018 


(.103**) 


.006 


.018 


.022 


.050 



Learning Style Inventory 



6.2 
9.7 
14.4 
16.4 

11.7 
18.4 



Age 



Age 



4.7 



2.:i 



029* 


.031 


.004 


.032 


010 


.001 


.016 


.027 


002 


.014 


.010 


.022 


014 


.023 


.034* 


.034 



.013 
.015 



.026 
.007 



.010 

.028 



.020 
.024 



Test of Thematic Anclysitf 



4.1 



Marital Status 5. a (.035*) .024 ,033 



.086** 



Critical Thinking Appraisal 



23.3 
13.4 



26.0 4.5 Grade Point Avg. 4.4 



.003 
.011 
.011 



.014 
.010 
.010 



.008 .009 
.011 .032 
.011 .025 



Life History Exercise^ 



23.0 

XXX 




E3 Data for Weekend College students only. 
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Table 'I 



L'd iVirt Correlations ol College Pro>iram Varinhlcs V 
Tlilrd JVflst^flsmencs ConcrolUng for Backsround 
CovarJaCcs and Second Assessmence 



Measure 



c 

3 
O 

< 00 



2 

sR Program Covarlaces 



Measure of Vocational, Educational, and Personal Issues 



"Best Class" Essay 
"Decision" Essay 
"Career" Essay 



3.4 
3.1 
11.0 



2.7 



. 008 

.038** 

.035* 



.007 
.005 
.011 



.017 .029 
.012 .Oiy 
.002 .057 



Sentence Completion Test 



24.2 



.002 



.011 



.022 



.007 



Moral Judgment Instrument 



12.2 



.270** (.207*) .033 .136 



Defining Isauea Test 



^y. Score 
D Score 



33.6 
41.3 



.009 
.019 



.013 
.011 



.006 
.005 



.036 
.010 



Test of Cognitive Development 



30.4 2.2 



.006 



.004 



.002 



.027 



Picture Story 'ixerclsc 



Stages of Adaptation 
Receptive 
Autonomous 
Aygertl.ve 
InceeraCivc 

Self-Def Inltion 

Achievement Motive 
Affiliation Motive 
Power Motive 



3.2 

3.8 2.2 
12.7 3.3 
4.2 

6.2 
5.8 

XXX 



010 


.015 


.001 


.040 


007 


.007 


.010 


.014 


019 


.011 


.020 


.039 


028 


.037 


.005 


.022 


009 


.002 


.006 


.04 3 


017 


.004 


.031 


.039 



Learning Stvle Inventory 



Concrete Exp<^.r lence 
Retlecttve Observation 
Abstract Conceptualization 
Active Experimentation 

Abstract/Concrete 

Lcamins Orientation 

Act ive/Rellective 

Learning Orientation 



15. 3 
27.4 

11.6 1.9 
30.0 

13.4 
32.7 



.000 .016 

.020 (.033*) 
.005 .010 
.016 .020 

.002 .007 

.022* (.030*) 



.014 .022 

.035* (.051*) 
.005 .015 
.005 .024 



.007 
.018 



.017 
.031 



Adaptive Style Inventory 



Total Concrete Experience 
Total Reflective Observation 
Total Abstract Conceptualization 
Total Active Exper Imenta ion 

Abst ract /Concrete 

Adaptive Orientation 
Active/Reflective 

Adaptive Orientation 



29.2 
18.9 
23.7 
20. 3 



31.2 
24.9 



1.8 
2.1 

2.^ 



Marital Status 4.7 



Marital Status 4.8 



.000 


.003 


.019 


.036 


.021 


.007 


.005 


.015 


.006 


.004 


.026 


.012 


.011 


.044* 


.001 


.014 


( .003*) 


.001 


.027* 


.028 



.033* .025 



.003 



.016 



Test of Thematic Analysis 



5.8 



Critical Thinking Appraisal 



Inference 
Recognit ion 
Deduct ion 



29.3 
20.4 
3'^. 2 



4.3 



.021 
.016 
.004 



.015 
.011 
.001 



.007 .005 
.024 .031 
.001 ^013 



Life History Exercise 



Performance 
Improvement 



17.2 

XXX 



.030* .020 



.006 



.027 



*£ < .05 
**n < .01 
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Table AA 



Comparison of Correlations Between Unexplained Variance in the 
First Interval and College Performance Variables 
In Raw and Corrected Form 



Measure 



Measure of Vocational, Education 
and Personal Issues 

"Best Class" Essay 

"Decision" Essay 

"Career" Essay 

Sentence Completion Test 
Moral Judgment Instrument 

Defining Issues Test 
?l Score 
D Score 

Test of Cognitive Development 

Picture Story Exercise 
Stages of Adaptation 

Receptive 

Autonomous 

Assertive 

Integrative 
Self-Definition 
Achievement Motive 
Affiliation Motive 
Power Motive 

Learning Style Inventory 
■Concrete Experience 
Reflective Observation 
Abstract Conceptualization 
Active Experimentation 



Corrected Form 



Number of Credit 
Semesters Hours 



Competence 
Level Units 



Raw Form 
Number of Credit 
Semesters Hours 



XXX 


XXX 


XXX 


XXX 


XXX 


XXX 


nx 


XXX 


-.027 


-.014 


.009 


-.043 


-.097 


.030 


.069 


-.099 


-.OU 


.001 


.092 


-.086 


-.004 


-.083 


-.049 


-.042 


-.054 


.013 


-.014 


-.083 


.070 


.011 


.065 


.039 


-.023 


.051 


.068 


.029 


-.097 


-.024 


-.079 


-.064 


-.m 


-.021 


-.148* 


-.059 


Ml 


.068 


.127(j)<.l) 


.060 


.055 


.050 


.111 


.072 



XXX 
XXX 

.064 

.068 



Competence 
Level Units 



.007 
.077 
-.033 


.004 
.089 
.040 


-.002 
.041 
.006 


,009 
.091 
-.083 


.065 
.039 
.024 


.066 
.059 
.019 


-.018 


.030 


.085 


-.021 


.055 


.122(£<.l) 


-.046 


.054 


.096 


.044 


.042 


.162 


-.014 
.140 


.134 
.065 


.144^£<.l) 
-.021 


.025 

.162(£<.l) 


(.188*) 
.023 


.237** 
-.007 


(.152*) 


(.180*) 


.228*** 


.134(2,'=-1) 


.120 


.171* 



XXX 
XXX 

.081 

.070 



.n4(£<.l) .148* 

-.053 -.076 

.045 .052 

-.076 .032 

-.021 .009, 



-.116 

.028 

.100 
-.029 



■.126(£<.l) 
-.104 
.144* 
.063 



ERIC 



*£ < .05 
Q < .01 



£ < .001 
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Tab It; h\ cont iiii.d 



Corrected F orm Form 
Number of Credit Competence Number of Credit Competence 
Semesters Hours Level Units Semesters Hours M'^cl Unit!; 



Analysis of Argument 

Attack XXX XXX 

Defense xxx xxx 



Critical Thinking Appraisal 
Inference 
Recognition' 
Deduction 

Life History Exercise 
Performance 



Learning Style Inventory 
(continued) 

Abstract/Concrete 

Learning Orientation .086 .050 .115 .071 .109 . 143 

Active/Reflective 

learning Orientation .051 . 025 .U^* .095 -.076 .066 

Adaptive Style Inventory 
Total Concrete Experience 
■ Total Reflective Observatior' 
Total Abstract Conceptualization 
Total Active Experimentation 
Abstract/Concrete Adaptive 

Orientation 
Active/Reflective Adaptive 
Orientation 

Test of Thematic Analysis -.023 -.U5(£<.1) -.058 -.023 -. 123 -.090 



xxx xxx xxx xxx 

xxx xxx xxx xxx 



-.117 -.053 .072 -.095 -.109 -.017 

.018 .050 .106 .043 -.048 .059 

..0/,3 -.049 "M^j -.038 -.068 -.086 



-.030 .036 -.005 -.022 .170 .101 

Improvement xxx ' xxx xxx xxx xxx xxx 



*l < .05 



Table BB 



Comparison of Correlations Between Unexplained Variance in the 
Second Interval and College Perforraance Variables 
in Raw and Corrected Form 



Measure 



Corrected Form 
Number of Credit Competence 
Sen,esters Honrs level Units, 



Heasure of Vocational, Education 
and Personal Issues 

"Best Class" Essay 

"Decision" Essay 

"Career" Essay 

Sentence Completion Test 
Moral Judgment Instrument 

Defining Issues Test 
PX Score 
D Score 

Test of Cognitive Development 

Picture Story Exercise 
Stages of Adaptation 

Receptive 

Autonomous 

Assertive 

IntcRrative 
Self-Definition 
Achievement Motive 
Affiliation Motive 
Power Motive 

Learning Style Inventory 
Concrete Experience 
Reflective Observation 
Abstract Conceptualization 
Active Experimentation 



■.071 
.020 
.026 

-.072 

. 026 



■.017 
.012 

.080 



XXX 

'.112 
-.168* 
.006 
.004 
.075 
-.056 

XXX 



.029 -.010 
.136(£<.i) .006 
.115 



.005 
.241 



.074 
-.131(£<.1) 
-.421*" 



.124 .003 
.150(£<.l) .136 



.077 



-.022 



XXX XXX 

.,14?* -.076 
-.136(p<.l)(-.I50*) 



-.029 
.017 
.084 

-.022 

XXX 



-.023 
-.069 

.119(£<.l) 
-.070 

XXX 



-.061 


-.153* 


.008 


-.012 


-.106 


-.097 


.047 


.087 


-.080 


-.00? 


.037 


.103 





Raw Form 




Number of 


Credit 


Competence 


Semesters 


Hours 


Level Units 


.008 


.081 


.027 


-.081 


-.054 


-.127(£<.l) 


.047 


.188 


-.367* 


-.023 


.562 


-.030 


-.009 


.100 


.115 


.064 


.029 


.024 



XXX 


XXX 


XXX 


-.139(£<.l) 


-.011 


-.042 


-.146* 


-.075 


-.152* 


-.037 


-.010 


.010 


.033 


-.102 


-.137(£- 


.053 


.035 


.114 


-.079 


-.056 


-.077 


XXX 


XXX 


XXX 



-.051 


-.144* , 


.011 


-.043 


.024 


-.024 


.027 


.096 


•-.074 


.035 


.044 


-.021 



*£ < .05 

**£ < .01 
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Table BR contimied 



Corrected Form 



Raw Forr 



Measure 


Number of 


Credit 


Competence 


Number of 


Credit 


Competence 


Semesters 


Hours 


Level Units 


Semesters 


Hours 


Level Units 


Learning Style Inventory 














(continued) 














Abstract/Concrete 














Learning Orientation 


.071 


.U9* 


-.055 


.056 


.135(£<.l) 


-.054 


Active/Reflective 












Learnl^'g Orientation 


.015 


.090 


.132(£<:.l) 


.025 


.039 


.079 


Adaptive Style Inventory 














Total Concrete Experience 


-.007 


-.051 


-.012 


.019 


.059 


.064 


lOLcll tVt:LicCLlVc UUacLVdLXUn 




1 ')'\ln< 1 \ 








051 


Total \bstract Conceptualization 


.017 


.089 


.325 


-.010 


.050 


.009 


Tofal Active Exoerinentation 


-.060 


-.161* 


-.100 


-.056 


--U2 


-.089 


Abstract/Concrete Adaptive 














Orientation 


.003 


.078 


.017 


-.035 


.019 


-.034 


Active/Reflective Adaptive 














Vl 1 vU Lot XvH 




-.155* 


-.038 


-.099 


-.081 


-.056 


I* 

Test of Thematic Analysis 


-.215** 


-.074 


-.108 
f 


-.184* 


-.145* 


-.150* , 


Analysis of Argument 














(1 L LaV. Ix 


XXX 


XXX 


XXX 


XXX 


XXX 


XXX - 


Defense 


XXX 


XXX 


XXX 


XXX 


XXX 


XXX 


Critical Thinking Appraisal 












-.008 


Inference 


-.078 


-.063 


-.000 


-.042 


Art 1 

-.093 


Recognition 


.015 


.006 


-.058 


.039 


-.063 


-.067 


Deduction 


-.070 


.016 


-.023 


-.055 


.037 


-.046 


Life History Exercise 












.U0{£<.1) 


Performance 


.049 


.079 


.072 


.059 


.133(p<.l) 


Improvement 


XXX 


XXX 


XXX 


XXX 


XXX 


XXX 



*£ < .05 

**£ < .01 
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Tabic CC 



Entriinci.' Assessmont Correl.Ulon Mrh 



Measure 



10 



'n u 15 If) 



(11 "Best Clasfl" Essay 
(2) 
(3) 

(4) 
(5) 



"Decidon" Essay 














"Career" Essay 




.37*** 












.19** 


,11 


,28*** 










,24 


-.02 


.10 


.01 






p; Score 


,12 


,21«* 


,28*** 


,33*** 


.35* 




D Score 


.0] 


.22** 


,21** 


.22** 


,28 


,71*** 




.13* 


.10 


,19** 


,24*** 


,01 


.35*** 



K) 

ro 

00 



25o 



(8) 

Stages of AdapUtlon 

(9) Rccepllve 

(10) Autonomous 

(11) Assertive 

(12) Integrative 

(13) Self-Definition 

(U) AchleveaienL Hotlve 
(15) Affillatloa Hotlve 
.(15) Power Motive 

(IJ) Concrete Experience 

(IB) Reflective ObBervatioti 

(W Abstract Conceptualization 

(20) Active Experimentatiuu. ^ 

(21) Abstract/Concrote 

Learning Orlcnifltton 

(22) Active/Reflective 

Learning Orientation 



(23) : 

(24) Attack 

(25) Defense 

(26) Inference 

(27) Recognlton 
(26) Deduction 



(29) Perforinancc 

(30) Iniproveiiient 



*£ < .05 
**£ < .01 



.00 


-.02 


-.08 


-.04 


,11 


-,14* 


-,06 


,07 




A)' 


,11/ 




Oft 


, Uj 




- 02 


-.02 


,04 


,14* 


,05 


-,01 


,00 


-.12 


.01 


.01 


-.03 


-.06 . 


.13* 


,09 


.09 


,04 


.02 


-,01 


.03 


,13* 


,05 -. 






lU/ 




-.44** 


- 10 


,00 


,10 


,26'" -, 


-15* 


-.00 


,02 


-.10 


.17 


,05 


.10 


-.01 


-.14* , 




* n(3 






- u 


- 14* 

* it 


-.05 


-.09 


.17** -, 




. un 


HQ 




,09 


.04 


.02 


,08 


,10 . 


.08 


,07 


.05 


-.35 


-.06 


-,.09 


,09 


-.07 


.12* -, 


.05 


-,02 


,08 


,07 


-.23 


-,01 


-.01 


,11 


-,05 


,01 


-.04 


-,05 


-,fll 


-,01 


.02 


-,07 


,14* 


,04 -, 


,11 


-,06 


-.11 


-.01 


-,05 


-.01 


-.02 


-,15* 


,01 , 


,05 


-.0) 


-.06 


,02 


,02 


,06 


-,09 


.13* 


-,04 -, 


,09 


-.02 


-.11 


-.05 


,10 


-,03 


-,00 


-.15* 


,04 . 


.10 


,08 


,14* 


,25*** 


.34* 


,18 


,21** 


,29*** 


,02 , 


,04 


,03 


.09 


.03 


-.11 


,01 


,03 


,09 


-,05 ^ , 


.02 


-,11 


-.04 


-.01 


-.22 


-,17* 


-,13 


-,21** 


-.17* . 


.03 


.14* 


,18* 


,07 


,37 


,35*** 


,42*** 


.28*** 


.13* 


-.02 


,07 


-,00 


.04 


,15 


,06 


,23** 


.21** 


,10 


.09 


,15* 


.11 




.10 


,30*** 


,27*** 


,35*** 


.08 


,tT 


-,19 


,05 


■■.01 


.12 


.30* 


.24* 


.17 


-.13 


-.05 


-.29* 


,04 


-.0^ 


,45 


-.10 


",37** 


-.14 


-,06 - 



18** 

01 



02 

21** 

24*** 

01 
11 

02 
12 

01 
13 

12* 

10 
01 

06 
02 



,08 


.15* 










,04 


,26*** 


,07 








.19** 


-.01 


,04 


-.20** 






,38*** 


.07 


.23 


-,09 


-.18** 




.01 


-,05 


-.00 


,03 


,00 


-.01 


.05 


-,04 


,02 


-,09 


,01 


-.09 


,04 


-,04 


,10 


.03 


,05 


-,05 


,09 


.10 


-.03 


,11 


,03 


,08 


,03 


-.00 


,06 


,00 


.03 


-.03 


,07 


.07 


-,03 


,11 


,01 


.10 


,08 


,0J 


-,06 


,00 


,08 


,07 


.05 


-.06 


-,03 


.09 


-,0d 


-,01 


-.10 


-,04 


-.10 


,17* 


.06 


-.11 


•,07 


.14* 


,08' 


,11 


-.13* 


.00 


•,07 


,05 


,01 


.14* 


.05 


-,02 


-,15* 


,06 


,15* 


.10 


-.00 


.03 


-.06 


-,08 


■,15' 


,15 


-.20 


-.15 


,05 


.14 


-,05 


,10 


-.15 


-.12 



Table CC continued 



Measure 



17 



18 



19 ,20 21 22 



2] 



TC" 25 26 27 28 29 



30 



(17) Concrete Experience ' 

(18) Reflective Observation 

(19) Abstract Conceptualization 

(20) Active Experimentation 

(21) Abstract/Concrete 

Learning Orientation 

(22) Active/Reflective 

Learning Orientation 

(23) 

(24) Attack 

(25) Defence 

(26) Inference 

(27) Rftco^riitlon 

(28) Declucticn 

(29) Performance 

(30) Improvement 



*l < .05 

< .01 
***£ < .001 



.07 

.3^*** -.13* 

.09 ".51*** .Zi**** 



-.78*** 


-.04 


-.85*** 


-.11 


— 














1 

■ UU 


t 7 U 


- OA 


fiw* 


■ U J 














-.Ci', 


-.00 


.14* 


-.06 


,12 


-.03 












-.02 


' .03 


-.02 


.02 


-.00 


-.01 


-.00 










-.01 


-.01 


.00 


.02 


.01 


,.02 


.00 


-.04 








.02 


.06 


.03 


-.11 


.01 


/ 

' -.09 


.15* 


.11 


-.06 






.10 


-.06 


.10 


-.09 


.01 / 


-.01 


.16" 


.01 


-.07 


.29*** 




-.04 


.02 


.16* 


-.21** 


.13*' 


-.12* 


.22*** 


-.04 


-.23** 


.29*** 


,38**" - 


-.06 


-.13 


.12 


-.04 • 


.U 


.06 


.11 


-.01 


.17 


.09 


,15 -.01 


-.11 


,20 


.15 


-.29* 


.16 


-.27* 


.13 


.19 


.15 


-.11 


-.19 -.14 



.02 
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APPENDIX II 
APPENDIX A 



ALVERNO COLLEGE INTER-OFFICE CORRESPONDENCE 

Milwaukee, Vtfiscontin 53215 



To: Christine Trimberger 
Lucy Cromwell 
Rosemary Hufker 
Leona Truchan 
Mary Hueller 
Allen Wutzdorff 

From: Marcia Mentko^vski 

Date: February 13, 1978 

Re: Study of Seniors 



At the recent chairpersons' meeting, I discussed the procedures for assessment 
of the May graduates. Many of the students in professional areas, such as 
Nursing, Education and Music; have been introduced to the study via their 
classes For some students, the lack of shared classes requires that they 
be introduced through Individual appointments with me during the next two weeks, 

I would greatly appreciate your assistance in encouraging these students to 

participate in the study. In order to save your tine I have drafted the 

following memo. Would ycu be willing to^ send it to those students and sign 
your name? * 

Thank you. 



ERIC 
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APPENDIX B 



Alvern9 College March 6, 1978 



Dear graduating senior, 

All graduating seniors have now been personally introduced by 
Marcia Mentkowski to the project funded by the National Institute of 
Education to advance understanding of women's professionalism. As a 
follow-up to our earlier agreement, we wish to reaffirm the dates for 
your participation as a graduating senior in music. 



Assessment Day, March 10 

Room 076, Nursing Education Building 



Because of time requests on your part, we have arranged the 
following schedule. The schedule includes adequate break time to 
insure that the process does not create too much fatigue. 

I 

7:45-8:00 Coffee, Tea and Doughnuts 
8:00-11:30 Timed Assessments 
11:30-12:30 Lunch Break 

12: 30- (We expect that you will finish sometime 
between 2 toj 3 p.m.) 

i 

If you have an anticipated, conflict with this schedule, please 
come to the music office. \ 

\ 



Assessment Week: May 8, 9, or 10 



During Assessment Week, you w|ll be asked to complete the Written 
Interview for Graduating Seniors. As\soon as the final exam schedule has 
been printed, we will ask you to choose a one-hour appointment on either 
May 8, 9, or 10 from 12-3 p.m. in Kellpgg A. 

You may also recall that Marcia Mentkowski is choosing 20 names 
from the hat for special oral interviews with her. If you are chosen, 
you will be contacted to arrange a Lime convenient for you. 

\ 

Dr. Mentkowski will meet you March 10 at 7:45 for coffee in 
Room 076 in the Nursing education Building. Tliank you for this profes- 
sional contribution. 

\ 

Sincerely, 



S. Mary Hue Her, Chairperson 
Division of Performing Arts 
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APPENDIX C 




AlvernQ College 



April 7, 1978 



Dear graduating senior, 

You may recall Marcia Mentkowski's explanation of the graduating 
senior assessments. At that time, she explained that she would invite 
each senior to record their perspective on their college experience via 
a written interview during assessment week. We chose assessment week, 
because seniors graduating previously indicated that it was when they 
had "picked up a cap and gown" that they began to reflect on the last 
four years. 

This written interview, which is confidential, can be completed 
in 45 minutes to an hour and a half. We have scheduled three time blocks 
during assessment week for you to stop by Kellogg A to complete your 
interview: 

May 8 12-3 Kellogg A 

May 9 12-3 Kellogg A 

May 10 12-3 Kellogg A 

We ask that you indicate on the attached form vhen you will be 
visiting Kellogg A to complete your written interview. Vlease return 
this form to Marcia Mentkowski's mailbox. 

At the time you come for the wr^^ten interview you will also 
receive feedback on the Learning Style Inventory, one of the assessments 
you completed this semester. 

Thank you for sharing so much of yourself. 

Cordially, 



Marcia Mentkfcvski 
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APPENDIX C continued 



TIMES AVAIUBLE — KELLOGG A 

May 8 12-3 
May 9 12-3 
May 10 12-3 

Note: (The Interview takes 45 minutes to an hour axid 

************ 



I will come to Kellogg A on 

/ / May 8 — sometime between 12 and 3 

/ 7 May 9 — sometime between 12 and 3 

/ / May 10 — sometime between 12 and 3 



Ntime 
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APPENDIX D 



AlvernQ College 



May 5, 1978 



Dear graduating senior, 

I wish to take this opportunity to thank you for your contribution 
to the study funded by the National Institute of Education that you par- 
ticipated in this semester. I have been extremely gratified by the 
professional responsibility demonstrated by you and the other graduating 
seniors. 

I promised to mail your feedback on the Learning Style Inventory 
before graduation as part of my continuing commitment to you to apprise 
you of outcomes of the study that may be of benefit to you in your future 
professional development. The Learning Style Inventory is one of the 
inventories you completed that we expect will contribute to the validation 
of the Alverno degree, and tc this study of women's perspective on pro- 
fessionalism and personal development. I expect that feedback on your 
score will assist you in interpreting and understanding your preferred 
learning style. 

Your results are enclosed. I have also included several explanatory 
pages describing the theoretical base for the inventory. Instructions 
for interpreting the Learning Style Profile and several tables describing 
comparisons on the inventory for several groups are also included. 

Additional feedback on the other inventories and research results 
will be mailed to you as soon as it becomes available. Keeping your 
address current with the Alverno Alumnae Association will assist me in 
mailing other information, and ia contacting the followup study groups in 
spring of 1980. Since we do have your permanent address, I expect that 
we will be able to reach you with feedback there. 



Again, your contribution has made this work possible, I thank you 
and congratulate you on your graduation. 



\ 



Best wishes for the years ahead, 




Marcia L. Mentkowski, Ph.D. 
Associate Professor of Psychology 
Director of Evaluation 
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APPENDIX E 



Alverno College 



March \3, 1978 



Dear student, 

You may recall that when you entered Alverno in the fall of 
1977, you participated in a series of long-range inventories. 
The purpose of these inventories is to establish the validity 
of the Alverno College degree. Last fall, you were promised feed-- 
back on these inventories as it became available. 

One of the instruments, the Learnin;^ Style Inventory , has 
been scored. We have prepared a feedback session for giving each 
person a profile of their learning style. We expect this session 
to provide you with an additional tool that will assist you in 
the many learning situations you are invloved in as a college 
student. This session has been scheduled for Friday > March 17 , 
from 12:30 to 1:30 pm in the Administration Building (Liberal Arts) 
room 106 . At this time, we will explain the meaning and implica- 
tions of these profiles to the group. 

We look forward to providing this service to you as a way of 
showing our appreciation for you participation last fall. 



Please indicate your plans for this feedback session: 

I plan to attend the feedback session March 17 at 12:30 in LA 106 

I will be unable to attend. 




Sincerely, 




Marcia Mentkowski 

Director, Office of Evaluation 



(tear off) 



Please return this sUp to my mailbox Thank you! 

2 3(.) 




ALVERNO COLLEGE 
OFFICE OF RESEARCH AND EVALUATION 



CHANGES IN STUDENT PROFILES ON THE LEARNING STYLE INVENTORY 



FIRST REPORT TO PARTICIPANTS IN A 
LONGITUDINAL STUDY OF COLLEGE OUTCOMES 



Marcia Mentkowski 



Funded by a grant from the National Institute of Education: 
Careering After College: Establishing the Validity of Abilities 
Learned in College for Later Success 
(NIE-G-77-0058) 

Principal Investigators: 

Marcia Mentkowski 

Austin Doherty 

Alverno College 

3401 South 39th Street 

Milwaukee, Wisconsin 53215 



(c) Copyright 1981. Alverno College Productions, Milwaukee, Wisconsin. A!l rights reserved under U.S., International 
and Universal Copyright Conventions. Reproduction in part or whok by any method is prohibited by law. 
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3401 S :i9\r'. ""rcr:* 

A 

£mm\ Alverno College 



Dear Participant, 



The data from the Learning Style Inventory I wish to share with you 
in this brief report are truly exciting. I expect that when you finish 
reviewing the materials, you will share the feeling I have had over the 
last few weeks as I reviewed the computer printouts: there is something 
happening here in regard to the development of learning style, based on 
students' report of their learning style preferences, that will shed 
light on the effects of college on students. This information will add 
to current theoretical assumptions about how learning style develops, and 
how it is affected by the college experience. 



READ THE PINK SHEET 



Before you continue reading this letter, read the enclosed pink sheet 
describing the theoretical base underlying learning style. It gives 
meaning to the Alverno curriculum's emphasis on experiential learning 
(OCEL/ONCEL/clinical and other field experiences). (Note: Working for a 
living can also be termed "experiential learning".') 

READ THE YELLOW SHEETS THAT SHOW 
YOU HOW TO INTERPRET YOUR SCORES 

Now that you understand the theory, carefully read the information 
explaining how the Learning Style Inventory results may be interpreted. 

FIRST EXAMINE YOTO INDIVIDUAL LEARNING STYLE PROFILE AM) TOEN THE GROUP REPORT 

I hope you will find the dif f erences ^ or similarities in your 
preferences from 1977 to 1979 interesting! 

Because I cannot speak to you in person to qualify what you may be 
interpreting, I have included the following "qualifiers" to aid your 
interpretation of your individual Learning Style Inventory feedback. 



QUALIFIERS IN INTERPRETING RESULTS 
FROM THE LEARNING STYLE INVENTORY 

As future professionals, you are becoming more and more aware of 
contributions that data from a particular inventory can make to our 
understanding of the learning process. You are also, however, becoming 
increasingly aware of limitations such inventories have in their ability 
to add to our understanding, the accompanying materials identify the 
contributions. I now wish to apprise you of the limitations of the 
Learning Style Inventory, because I would not want anyone to either 
misinterpret or overemphc size^ the results . 
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1. The in ventory is a measure of preference, not ''personality ." 

One way to misinterpret the Learning Style Inventory is to assume that 
it says something about one's level of intelligence or personality. Rather, 
the inventory is a measure of one's preference for a particular learning 
style. Does that mean tliat if a person strongly prefers a particular 
, learning style he or she is incapable of using other styles? Nol It simply 
means that the person has a preference for a particular style. 

2 . The Learning Style Inventory is not a perfect indicator of an 
individual's learning sty::e . 

No inventory is completely accurate— don ' t trust your individual 
results too much. Each inventory contains "measurement error." While we 
are able to estimate the extent to which large group results contain error 
due to cbanc.i, I cannot tell the extent to which your individual score is 
affected by a variety of factors. Perhaps you interpreted some words 
differently the first time you took the inventory than you did when you took 
the inventory the second time. Perhaps you were more nervous the first time. 
Perhaps you spent more time on it the second time. No inventory is com- 
pletely accurate. Consider this as you interpret your feedback. 

3. Individual trends in the development of learning style preference 
m ay be different from the group trends . 

There are certain trends in the development of learning style prefer- 
ence if we look at students as a group from tin.e one to time two. Your 
individual development of preferences may be quite different from that of 
the group. The fact tliat an individual score differs from a group trend 
is an indicator that one's perferences have developed in a different 
direction, nothing more. People have different patterns of development. 

Frankly, I am certain that Alverno students, with their vast experi- 
ence in taking assessments, are experts in how to interpret results 
showing a pattern of individual preferences. I vjould not be so 
comfortable giving out individual results at another college where 
students are likely to think of an inventory as giving personal informa- 
tion about success or failure . 

Incidently, some people don't change at all during a particular time 
period. I took the Learning Style Inventory in January, 1977, and again 
in January of 197 8. 1 had not changed in my^ preference one bit! Perhaps 
some time in the future' my preferences may change. But so far tliey 
haven't that I can see. 

4 . Th e group data you wi ll see on the following pa ^es is in teres ting ^jMj_t_j;or 
now, I can onl y. spec i ilat e on why these changes show up in Alverno 
s_tMjdent s as a group. 

Development in learning style preference varies for individuals for 
a variety of reasons L cannot pinpoint. Wlien all. the results aro. in from 
the evaluation study, I may he able to say with more certainty vvliy these 
changes occur, 

Cood reading I 

Marcia Mentk^^ki , Ph.D. 240 / j 

Director of Evaluation 



Kolb's Experiential Learning Theory 



At the undergraduate or college level , experiential learning has long been part 
of the curriculum — especially as. field experience, foreign study, or a winter session 
away fpm the campus. There is an assumption that any or all of these activities in 
some way contribute to the human development of the person. But how and why ? 

One of the most persuasive theories today as to the "why" of the case for 
experiential learning i^ that of David Kolb. His learning theory is labeled 
"experiential" precisely because IL underscores the importance of experience in Lhe 
learning process. Kolb (1976) describes his model of the learning process as "a 

simnie description of the learning cycle of how experience is translated into concepts 

2 

which in turn are used as guides in the choice of new experiences (p. 2)." 

TABLE I 



Immediate 



Cone re te Experience 



is the basis fcr 



and followed by 



Testing Implications 
of Concepts in New 
Si tuat ions 



\>7hlch lead to 



Observat ion 

and 
Ref lec Lion 



which are assimilated into the 



Formation of Abstract 

Concepts and Generalizations 



from which implications for 
action are deduced 

KolhVs four sta^c cycle is both circular and dialectic: circular bet:au.so LoarninK 
begins wi Lh. experience and ends wiLh new experiences; dialectic because learning 
requires abilities that are opposiLes (concrete/abstract) (active/ref lecLivo) . 

Kolb's Llieory is likewise developmental. Growth toward adulthood is rtMMccLed 
in th^^ ability Lo choose and demonstrate the learning', style m^^st appropriate to a new 
learning situation. Ratliur than being characterized by a dominant style, the mature 
learner is characterized by the integration of all learning styles and the /ibiiity to 
adapt to a variety of Learning', situations, despite tlieir complexity. 

^Adapted from A. Doherty, M. Mentkowski, & K. Conrad, Toward a theory of 
experiential learning, in Morris M Keeton and Pamela J. Tate (Eds.), ^Lc!ilJLLr.<^i^iJ^^ 
for Experiential Learning, No. 1 '(San l-rancisco: Jossey-Bass, 1978). 

9 ^David A. Kolb, L(Mrniiu> Style Inventory: Teclmical manual (Boston: Mcik^r, 107fS). 
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Knrly on, the different learning styles can develop separately from tlio others. 
In an academic setting where lectures and readings receive high priority, the student's 
ability to engage in reflective observation and abstract conceptualization is fostered. 
But will the other^ learning styles, concvetc experience and active experimentation, be 
■Jeveioped equally? Will they also be recognized as abilities that need to be equally 
fostered so that' integration of learning styles can develop? 

- Aeeordi'ng to Kolb, integration leads to increased adaptability. His thesis is 
that affective and behavioral complexity gained through concrete experience and active 
experimentation, respectively, are as essential to the learner^s development as the 
perceptual^and symbolic complexity" gained through reflective observation v^nd abstract 
conceptualization. 

I addition to providing a rationale for including experiential learning as part . 
of I learning process, Kolb has introduced an easy, effective tool for diagnosis of 
a student Vs predominant learning style: the Learning Style Inventory (LSI). 
Because of individual differences and a variety of learning histories, persons develop 
a preferred learning style that is relatively stable. Each individual resoLves'the • 
dialectic between being active or refleccive and being immediate (concrete) or 
analytical in a measurable way. While the Learning Style Inventory assesses strengths 
and weaknesses of learners, Kolb has set as a goal for educa tors that of enliancLng 
the degre^^ to whlcli an IndividuaTs learning style is balanced and adaptive. 

Wliat implications does this diagnostic attempt have? Learning Style Inventory 
data generJite several Implications for pedagogy. Should learning experiences be 
matched to the student^s preferred learning style? If a student is aware of his/her. 
preferred learning style, he/she may choose learning situations more appropriate for 
lliat preference. However, the Instructor should also structure learning to encourage 
adaptability. The learner's ultimate goal is to operate e f f el^"tively in a variety of 
learning situ.Uions, and to be able to exercise the ci.rcu]ar learning process: 
involve oneself fully and uitluuit bias in new experiences, observe and reflect on tlie 
experience from nianv perspectives, integrate experience through creating abstract 
concupts, and actively test out one's "theory'; or concepts through decision-making 
and problem solving. Only then can we assert that a curriculum is facilitating 
learning and also development. 

While experiential learning has often been left out of the educational process,, 
Kolh's theory cautions against the opposite extreme; the assumption that any or all 
experience can facilitate learning In the r.bsence of the other Learning modes. Only 
.■xperience that lias been roflected on in a variety of Vv/ays is likely t<^ facilitate 
learning, and tiiat, as Kolb has indicated, involves a critical step— the translation 
of exp^.-rience into concepts. 
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booklet (Boston: Mciier, 1976). 
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Interpretation of Your Scores 
on the Learning Style Inventory 

The Learning Style Inventory (LSI) is a simple self-description test, based on 
experiential learning theory, that is designed to'measure your strengths and weaknesses 
as a learner. ExperientLl learning is cor ceived as a four stage cycle: (1) immediate 
concrete experience is the ^ asis for (2) observation and reflection; (3) these observations ' 
are assimilatc'd into a "theory' from which new implications for action can be deduced; 
(4) these implications or hypotheses then serve as guides in acting to create new 
experiences. The effective learner relies on four different learning modes— Co;/m'/t' 
'Experience (CE), Reflective Observatio)i (RO), Abstract, Ctviceplualizatioii (AC), and Active 
Experimeiitatio}} ( AE). That is, he must be able to involve himself fully, openly, and 
without bias in new experiences (CE), he must be able to reflect on and observe these 
experiences from many perspectives (RO), he must be able to create concepts that 
integrate his observations into logically sound theories (AC), and he must be able to use 
these theories tolriake decisions and ^olve problems (AE). 

The LSI measures your relative emphasis on the four learning modes by asking you 
to rank order a series of four words that describe these different abilities. For example, 
one set of four words is/t.v/^/;^^ ivatclwi^, thi)iki)i^, doiii^ which reflects CE, RO, AC, and 
AE, respectively. The inventory yields six scores: CE, RO, AC, and AE plus two 
combination scores that indicate the extent to which you emphasize abstractness over 
concreteness (AC -CE) and the extent to which yc)u emphasize active experimentation 
over reflection (AE-RG). 

One way to better imderstand the meaning of your scores on the LSI is to compare 
them with the scores of others. The "target" on the next page gives norms on the four 
basic scales (CE, RO, AC, AE) for 1,933 adults, ranging fr ^-n 18 to bO years of age. About 
two thirds of the group are men and the group as a whole is highly educa'^ed (two thirds 
have college degrees or higher). A wide range of octHipations and educational 
backgrounds are represented, including teachers, counselors, engineers, salespersons, 
managers, doctors and lawyers. 

The raw scores for each of the four basic scales are listed on the crossed lines ot the 
target. By circling your raw scores on the four scales and connecting them with straight 
lines you can create a graphic representation of your learning style profile. The concentric 
circles on the target represent percentile scores, for the normative group. For example, if 
your raw score on Concrete Experie}ice was 13, you scored higher on this scale than about 
55% of the people in the normative group. If your CE score was 22 or higher, you scored 
higher than 99% of the normative group. Therefore, in comparison to the normative 
group, the shape of your profile indicates which of the four basic modes you tendjo 
emphasize and which are less emphasized. 




USED FOR RESEARCH PURPOSES ONLY 

Tills deactiption hac v>('t>u rxccrpied from lUv I oi lowing nourr-j: 

Kolb, Diivid A. L» .rt,in« 5:ryi.« Invuniory: Sc 1 1 -bi or i.ij-. Vent ami 
Inicrt>reu'it Jon BooVitt. Ho'iu-n: Mcrirr and Conip.jny, 1976. 

243 



273 



■ • M 

A hi^i^^^eF^cin Concrete Experience represents a receptive, experience-based 
approach to learning that relies heavily on feeling-based judgments. H.gh CE individuals 
tend to be emdathetic and "people oriented." They generally find theoref.cal approaches 
to be unhelpful aKd prefer to treat each .situation as a unique case. They learn best from 
specific examples in which they can become involved. Individuals who eniphc.size 
Concrete Experience tend to be oriemed more towards peers and less towards authority in 
their approach to learning, and benefit most from feedback and discussion with fellow CE 



learners. 



A high score on Abstract Conceptualization indicates an analytical, conceptual 
approach to learning that relies heavilv^on logical thinking and rational evaluation. High 

individuals tend to be oriented more towards things and symbols and less towards 
other people Thev 'earn best in authoritv-directed, impersonal learning situations hat 
emphS'e theorv'and systemauc analysis. They are frustrated bv and benefit little from 
unstructured "discovery" learning approaches like exercises and simulations.^ 

A high score on Active Experimentation indicates an active, "doing" oricMitation to 
learning That relies heavily on experimentation. High AE individuals learn best when 
they can engage in such things as projects, homework, or small group discussions. They 
dislike passive learning situations such as lectures. These individuals tend to be 
extroverts. 

A hiRh score on Retlectivc Observation indicates a tentative, impartial and reflective 
approach to learning. High RO individuals rely heavily on careful observation in making 
uTn ents' and prefer learning situations such as lectures Ihat allow them t.^take the role 
of impartial objective observers. These individuals tend to be introverts. 
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Identifying Your Learning Style Type 

It is unlikely thnt vour learning style will be described accurately by just one of tbe 
tour preceding paragraphs. Tbis is because each person's learning style is a combination 
of the four basic learning modes. It is therefore more meaningful to describe your 
learning style by a single data point that combines your scores on the four basic modes. 
This is accomplished bv using the two combination scores, AC -CE and AE-RO. 'I hese 
scales indicate the degree to which you emphasize abstractness over con.reteness and 
action over reflection, respectively. 

The grid below has the raw scores for these two scales on the crossed lines (AC -CE 
on the vertical and AH -RO on the horizontal) and percentile scores based on the 
normative group on the sides. Bv markin;; vour raw scores on the two lines and plotting 
their point of interception you can find which of the four learning style quadrants you tall 
into. These four quadrants, labelled Aavinwodutor, Divcrs^cr, Coiiivr^cr, and A>sinuhUor, 
represent the four dominant learning styles. If your AC -CE score were -4 and your 
AE RO score were +8, vou would fall strongly in the Accommodator quadrant. An 
AC -CE score of +4 and an AE- RO score of +3 would put you only slightly in the 
Converger quadrant. 1 he closer your data point is to the point where the lines cross the 
more balanced is vour learning style. If your data point is close to any one of the lour 
corners, this indicates that you rely heavily on one particular learning style. 

EEARNING STYLE TYPE GRID 
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1 he tollowinj^ suinraar\' of tho tour bcisiclearnin^ stylo types is based on both 
research and clinieal obscrwition ot these patterns of LSI scopes. 

The Convrr^cr'^ dominant learning abilities are Abstract Conceptuali/.ation (AC) and 
Active Hxperimentation (AH). Tliis person's jj,reatest strength lies in the practical 
application of idej.s. A person with this stvle seems to do best in those situations like 
conventional intelligence tests where there is a single correct answer or solution to a 
question or problem. This person's knowledge is orgahi/.esi m such a way that through 
hypothetical-deductive reasoning this person can focus it on specific problems. Kes'Mrch 
on this stvle i)f leai'ning shows that Convergers are relativeU' unemotional, prefering to 
deal with things rather than people. Thev tend to have narrow technical interests, and 
choose to specialize in the physical sciences. This learning style is characteristic ot manv 
engineers. 

The Divciy^cr has the opposite learning strengths of the converger. This person is best 
at Concrete FAperience (CE) and Reflective Observation {RO). This person's greatest 
strength lies in imaginative abilitv. This person excels hi the ability to view Concrete 
situations from many perspectives. We have labelled this style "Diverger" because a 
person with this st\ le performs better in situations that trail for generation of ideas such as 
a "brainstorming" idea .session. Research shows that Divergers are interested in people 
and tend to be imaginatix e and emotional. Thev ha\'e broad cultural interests and tend to 
specialize in the arts. This stvle. is characteristic of individuals from humanities and liberal 
arts backgrounds. Counselors, organization development specialists and personnel 
'managers tend to be characterized bv this learning style 

Tho /IssZ/H/'/i/fo/ 's dominant Iteming abilities ore Abstr.u-t Lonccptiuilization (AC) and 
RoHectix o Obsorvotion (RO). This person's greatest strength lies in the ability to create 
theoretical models. This perst)n excels in inductive recYsoning and in as'similating 
dispc ate ob.servations into an integrated explanation. This person, like the converger, is 
less, interested in people and more concerned with abstract concepts, but is less 
jToncerned with the practical use of theories. For this person it is more important that the 
tlieorv be logicallv sound and precise; in a situation where a theory or plan does not til 
the "facts," the .Assimilator would be likely to disregard or re-examine the facts. As a 
result, this learning stvle is more characteristic of the basic sciences and mathematics 
rather than the applied sciences. In organization,-: this le.irning style is found most often 
in the research and planning departments. 

The AcconinuHiator has the opposite learning strength.s of the Assimilator. This person 
is best at Concrete Experience {Cli) and Active Experimentation (AH). This perst)n's 
greatest strength lies in doing things -in carrving out plans and experiments - and 
involving oneself in new experiences. This person tends to be more of a risk-taker than 
people with the other three learnmg styles. We have Labelled this person 
"Accommodator" because this person tends to excel in those situations where one must 
a'dapt oneself to specific immediate circumstances. In situations where a theory or plan 
does not fit the "facts," this person will \r,ost likely discard the plan or theorv. Fhis 
person tends to solve problems in an intuitive trial and error manner, relying heavily on 
other people for information rather than on one's own analyt'C ability. I he 
Accommodator is at ease with people but is sometimes sc'en a-, impatient and "push v." 
This person's educaiional background is i^ften in technical or practical fields such as 
business. In orgoni/ations people with this learning style are found in "action-oriented" 
jobs often in marketing or sales. 
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THE DEVELOPMENT OF LEARNING STYLE PlllilFERENCES AT ALVERNO COLLEGE 



The foLLowing preliminary report responds to two major questions about the 
development of Learning scyle preferences: (I) What is the impact of the college 
experience on Learning style preferences? (2) How do Learning styLe preferences 
change during coLLege? ResuLts from the cross-scctionaL study are presented in 
response to the first question on college impact. Results from the longitudinal 
study are then presented in response to the question of the development of learning 
StyLe during coLLege. 

I . WliAT IS THE IMPACT OF THE COLLEGE EXPERIENCE ON LEARNING STYLE PREFERENCES ? 

A. When Weekend College Women First Enter Alverno, How Do They Compare 
to Entering Students in the Weekday College'5'^ 

1. Weekend College womens*-^ preferences compared with Weekday 
Students' are significantly greater for Concrete Experience 
significantly less for Reflective Observation and significantly 
greater for Active Experimentation. Weekend students are no 
different in their preference for Abstract Conceptualization 
than the Weekday College women (Table I, Figure 1). 

2. Weekend College women are similar to Weekday students in learning 
style ty.n ( Diverger ) but the greater preferences for Concrete 
Experience and Active Experimentation and the lesser preference 
for Reflective Observation show up i^ere as well. On the Concrete/ 
Abstract dimension, Weekend students are farther toward the Concrete 
end of the dimension than the Weekday students. On the Reflective/ 
Active dimension, Weekday students are farther toward the Reflective 
end of the dimension than the Weekend students (Table I, Figure 2). 

B . How do Entering Weekend and Weekday College Women Compare to Weekday 
Graduates ? 

1. Weekday graduates are significantly less likely to prefer Concrete 
Experience than entering students in the Weaken'' and Weekday College 
(although the difference is less marked for the .kiay College 
students: (p<.057). Graduates are also signif i.Cc*atly less likely 
to prefer Reflective Observation and significantly more likely to 
prefer Abstract Conceptualization than entering students in both 
the Weekday and Weekend College. While entering Weekend women have 



This report was prepared by Marcia Mentkowski with the assista?.ce of 
Elizabeth Davies, Eunice Monroe, Mary Schneider and Donna Siakert. 

^Data reported from Fall, 1977. 

Weekend College womens ' average age is 33; Weekday womens * average age is 22. 
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a higher initial proLcrencc Lor Active Experimentation than entering 
Weekday women, neitiier -roup differ:; s ignif ic^int Ly from Weekday 
graduates in their preference for this style (Tables II and III 
and Figure I) . 

2. On the Concrete/Abstract dimension, tlie Weekday graduates liave 
changed their preferences significantly toward the Abstract, 
compared with Weekend and Weekday entering students. On the 
Ref lective/Act ive Ui.mension, Weekday graduates have changed 
their' preferences significantly toward the Active,, compared 
with V"Jeekday and Weekend euLering students (Tables II and III 
and Figure 2) . 

3. Weekday graduates are s ignii Leant ly uu-i - "balanced" in their 
preferences for the four learning styles (Figure I). These 
differences place graduates as a group in the Accommodator learning 
style type in contrast to entering students in both Weekday and Week- 
end College who prefer the Diverger learning style type (Figure 2). 

4. The largest signilicant differences found between Weekday graduates 
and students entering Alverno in 1976 hold: Weekday graduates 
prefer Rellective Observation significantly less and Abstract 
Conceptualization significantly more than entering students. No 
differences in preference for Concrete Experience and Active Experi- 
mentation appear bet;^oen the two groups (Table IV). These entering 
students also prefer the Diverger learning style type. 

Discussion: WHAT IS THE IMPACT OF THE COLLEGE EXPERIENCE ON LEARNING SIJYLE 
PREFERENCES? 4 

These interesting comparisons between entering students in the Weekend and 

Weekday College and Weekday Graduates allow us to examine to some extent the impact 

of the college experience on learning style preferences because we can control for 

tlie effects of change that may be due to general life xperiences or maturation. 

(Weekend women are, on the aver^^ge, II years older.) 

The ord.T fr,\n '^r.atest to least preferet'cc fur Concr-te Expe r i c lu.. ■ i 

|:qJ^i . W«. c.;.'ud Students > Weekday Students > Gradual es 



-^his finding could also reflect some differences between the entering students 
in 1976 and the Weekday entering students in 1977. Sincp Weekend College did not 
begin until the Fall of 1977, older more experienced women were probably more 
likely to enter Weekday College. In fact, the 1976 entering class as a group 
is less likely to prefer the reflective mode (r-<.058) and si -nif icant ly more 
likely to prefer the active mode (p<.05). Thie/ shows up ag m on the Reflective/ 
Acti\/e dimension where students entering in 1976 prefer less Reflective and more 
Active modes (p<.02) (Compare Table I and Table IV). 
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eekend College had not yet begun in Fall, 1976 
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Life cxperLonces do not change persons' pro iorencc.; 'Iron. Ll>e Concrete toward 
the Abstract on the Concrete/Abstract cimension. Indc d , life experiences enhauca 
one's prercrcnce for the Concrete hxper imentat ion learning style. 

The order from greatest to least preference for Reflective Otservati..n is: 

Weekday Students > Weekend Students > Graduates 
Life experiences (judged from the fact that Weekend entering women arr.- 11. 
years olderK will change persons' pr.fcrencos from the Reflective toward the 
Active on the Reflective/Active dimension. College enhances this developmental 
pattern. Compared with the Graduates' preferences - if their preferences are 
an accurate picture of college outcomes - we see that the entering Weekend women 
are more like the graduates on the Reflective/Active dimension. Indeed, there 
are no differences between the Weekend women and the graduates in their preference 
for Active Experimentation, whife entering Weekday women prefer this style 
significantly less than the Weekend womer. . Tliis confirms our conclusion that 
both life experiences and college experiences enhance this move from the 
Reflective to the Active on the Reflective/Active dimension. 

College, in contrast to life experience, does change persons' preferences 
from the Concrete toward the Abstract on the Concrete/Abstract dimension, 
weekend and Weekday entering students are alike in their preferences for Abstract 
Conceptualization when they enter college and both increase their preferences 
over two years. The most important finding, overall, is that college promotes 
a balanced learning style. From this we might infer that college graduates are 
more able to use the appropriate learning style in a given learning situation, 
rather than be quite so dependent ort their preferences. 



ERIC 



249 

273 



1 



1 1 , HOW DO LE.-^vlaNING STYLE PREFERENCI-:S DEVELOP D UR ING COLLEGIA ? 

A. How Do W1:1::K1)AY COLLEGE Students'- Cliange Their Learning Stylo 
Preterences After Two Years? 

Leainin^J- Style Profile (Table V, Figure 3) 

1. As a group, Weekday students who entered Alverno in Fail, 1977 
and who completed the Learning Style Inventory (LSI) again 

in Fail, 1979 have changed their preference for each of the 
four learning styles after two years as f ol lows : 

2 

a. Students have not significantly changed their prelereace 
for Concrete Experience. 

b. Students I significantly decreased their preference 
for Reflect. :i Observation. 

c. Students have significantly increased their prei.cirence for 
Abstract Conceptualization. 

d. Students have not significantly^ changed their preference 
for Active Experimentat ion- 

2. After two years, Weekday College students show a more balanced v 
learning style profile than they did when they entered Alverno. 

Learning Style Type (Table V, Figure 4) 

.'^ . As a rroup, Weekday students who entered Alverno in Fall, 1977 
and who completed the LSI again in Fall, 1979 h.-ve chaagecf their 
learning style type after two years as follows. 

a. Students have changed their preferences significantly on the 
Concrete/Abstract dimension from Concrete toward Abstract. 

b. Students have chan^d their preferences significantly on the 
Reflective/Active d^ension from Reflective toward Active. 

4. After two years, students |till prefer the Diverger learning 

ptyie t>pe, although they a^rs more balanced in their preferences 
for the other nypes as well. 



The.'^o. c. ,:7Ludents who were still enrolled at Alverno in Fall, 1979. 

^ e is . '-crease in preference, the change is not statistically 
significant, tuat is, it could be due to chance. 
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B. How Do WEEKEND COLLEGE Students^ Change Their Learning Style 
Preferences Af er Two Years? (Table V) 

Learning Style Profile (Table V, Figure 5) 

1. As a group, Weekend student*^ ^o entered Alverno in Fall, 1977 
and who completed the Les Style Inventory (LSI) again in ^ 
Spring or Fall, 1979 have changed their preference for each of 
the four lear\n.;)? V.tyles after two years as follows: 

a. Students have significantly decreased their preference for 
Concrete Experience . 

b. Students have significantly decreased their preference for 
Ref lect ive Observation . 

c. Students have significantly increased their preference for 
Abstract Conceptualization. 

d. Students have not changed their preference for Active 
Experiment at ion . - 

2. After two years. Weekend College students show a more balanced 
learning style profile than they did wiien they entered Alverno. 

Learning Style Type (Tab? V, Figure 6) 

3. As a group, Weekend students who entered Alverno in Fall, 1977 
and who completed the LSI again in Spring or Fall, 1979 have 
changed their learning style type after two years as follows: 

a. Students have changed their preferences significantly on 

the Coacrete/ Abstract dimension from Concrete toward Abstract. 

b. . Students haVfe changed their preferences significantly on 

the Reflective/Active dimension from Reflective toward Active- 

4. After two years, students have changed their preference from the 
DiverRer type to the Accommodator type, and they are more balanced 
in their preferences for other types as well. 



^These are students who entered Alverno in Fall, 1977 and were enrolled at 
.Alverno in Fall, 1979. Weekend . student s who graduateU aft ^ two years in Spring, 
1979 are also included in this group. 

^hile there is an increase in preference, the change is not statistically 
Q Significant, that is, i.t could be due to chance. 
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C. How uo Weekday College Students Who Entered ALverno in L976 
Chance Their Learning Style Preferences After Two Years? 

Learning Style Profile (Table VI, Figure 7) 

L. As a group, Weekday students who entered ALverno in Fall, 1976 
and who cSmpLeted the Learning Style Inventory (LSI) again in 
Fall, L978 have changed their preference for each of the 
four Learning styLes after two years as foLlows: 

a. Students nave significantly decreased their preference for 
Concrete Experience. 

b. Students have significantly decreased their preference for 
Reflective Observation. 

c. Students hav^e significantly Increased their preference for 
Abstract Conceptualization. 

d. Students have significantly decreased their preference f6r 
Active Experimentation. 

2 After, two years, Weekday College students who entered ALverno in 
FaLL, L976 show a more baLanced Learning styLe profiLe than they 
did when they entered ALverno. 

Learning StyLe Type (TabLe VI, Figure 8) 

3 As a group, Weekday students who entered ALverno in FaLL, L976 
and corapLeted the LSI again in FalL, 1978 have changed their 
Leai ling styLe type after two years as foLLows: 

a. Students have changed their preferences significant Ly 
on the Concrete/Abstract dimension from Concrete ^toward 
Abstract- 

b. Students have not changed their preferences significant Ly 
on the Ref Lective/Active dimension. This is due to 
students' preferences for Less RefLective styles and less 
Active styles and the differences balance each other to show 
no statistically significant ^ change on the dimension itself, 

4. After two years,' students have changed their preference from the 
Diverger type to the AssimiLator type, and they are more baLance 
in their preferences for other types as v/ell. 



■'■Weekend CoLLege had not yet begun in Fail, L976. 
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D. Do Weekday and Weekend Students Differ in L'he Way They Change During 
the First Two Years After They Enter College? (Table.' V) ' (Figures 
4 and 6) 

1. Both Weekday,, and Weekend College students' preferences on the 
Lejjrning StyV^i Inventory changed across time in the following 
directions: Students, after two years in college, tended to 
orefer Concrete Experience loss (although this change is 
significant only for the Weekend students), Reflective Observation 
less, Abstract Conceptualization more, and Active Experimentation 
tho. same. S'tudents shifted significantly in their preferences 
from the Concrete toward the Abstract on the Concrete/Abstract 

- dimension and from the Reflective toward the Active on the Reflective/ 
Active dimension. When we compare- Weekday with Weekend students 
across time, however, we find that there are significant differences 
between the two groups. 

2. There ar^ no significant differences between Weekend and Weekday 
• " ' students in their initial preferences for Concrete Exper nee 

or for their later preference. Both groups reduce their preference 
for Concrete Experience across time although only the Weekend 
College student difference is statistically significant. Both 
groups prefer Abstractt Conceptualization o the same degree 
initially. Rut Weekday students have a significantly greater 
preference for Abstract Conceptualization, as a learning style 
after two years in college than do the Weekend College students — 
even though both groups begin Alverno with no difference in 
their prefer'ence for Abstract Concep-ualization. There is a 
significant difference between the two groups on the Concrete/ 
Abstract Dimension (p<.01) both when they ent. and two years 
later. Weekend students prefer more Concrete styles and Weekday 
more Abstract and this yields a significant difference between 
the two groups on the Concrete/Abstra ct Dimension. 

3. Both weekday and Weekend students significantly reduce their 

> preference for Reflective Observation after tv/o years, but do 
nof significantly change their preference for Active Experimentation 
after two years. Even though the change in preference for Active 
Experimentation over time is not statistically significant, the 
Weekend women do change toward greater preference for Active 
Experimentation, and the Weekday women change toward lesser 
preference for Active Experimentation. Thus, there is a difference 
between the two groups, on the Reflective/Active dimension (p<.05). 
Weekend w^men tend to prefer the Active Experimentation style 
more than the Weekday women after two years (p<.05). Weekend 
students prefer more Active styles and Weekday students more 
Reflective and this yields a significant difference between the 
two groups on the Reflective/Active dimension initially and 
after two years. 



^This section compares students in the 1977-1979 longitudinal study only. 

^Results are, based on a 2 X 2 Repeated Measure Analysis of Variance, Group 
(Weekday and Weekend) by Time (1977 and 1979). 
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Discussion: HOW DO LEARNING STYLE PREFERENCES DEVELOP DURING COLLEGE? 



Both Weekday and Weekend students liave become more "balanced" in their 
learning style preferences. Frt)in this v/e may infer tliat they are able to 
call forth a [^articular learning style irrespective of the learning'; situation 
in which they find themselves. Both groups have moved from the Concrete to 
the Abstract on the Concrete/Abstract dimension and from the Reflective to 
the Active on the Reflective/Active dimension. The clearest findin^^ is that 
the direction of this change is supported by both the longitudinal and cross- 
sectional data. But when we compare the two grou] of students — Weekday 
and Weekend, we find significant changes on both dimensions. The pattern 
seems to'pe: Weekend women prefer more Concrete and more Active styles wlien 
they enter and also two years later; Weekday women prefer more Reflective 
and more At)S tract styles than tlu/ Weekend women, w!ien they enter and alsc^ 
two years later. 

lliG cross-sectional comparison suggested that life experience creates 
movement along the Reflective/Active dimension, and in the absence of 
college — a higher initial preference for Concrete Experience. College 
enhances r jvement on this dimension. Only the college experience can create 
movement i rom the Concrete to the Abstract on the Concrete/Abstract dimension. 

Weekday and Weekend women both were "Divergers" when they entered. Two 
years later, the Weekday students are still Divergers, and the Weekend women 
are Accommodators — as were the 1978 Weekday graduates. 

Weekday students — many of them fresh out of high school — are affected 
more by the college-enhanced support for a change toward Abstract Conceptual- 
ization, and make their greates t change on the Concrete/Abstract dimension 
after two years, l^/tiile Weekend College women also change in the same 
direction, they change less toward r,he Abstract. Tliey make their greatest 
shift on the Reflective/Active dimension. They continue their development 
toward Active Experimentation, a college supported change that may receive 
additional reinforcement from the work environment most Weekend College 
women experience concurrently. Only another look at learning style prefer- 
ences two yer.rs from now — at graduation, can fully support these tenative 
cone lus t ions . 
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Ll-ARNING STYLE INVENTORY (LSI) RESULTS: CROSS-SECTIONAL 
COMFAIUSONS OF VARIOUS CROUPS OE ST'UDENTS AT ALVERNO COLLECE 



TABLE I 



GROUP 


n 




CE 


RO 


AC 


AE 


AC-CE 


AE-RO 


itering WEEKDAY 
tudents. Fall, 1977 

ntering WEEKEND 
tudents, Fall, 1977 


201 
267 


Mean 
S.D. 

Mean 
S.D. 


15 . 76* 
2.54 

16.3-y'- 
2.91 


15 . 20--'- 
3.45 

14.43* 
3.71 


15.31 
3.33 

13.09 
3.34 


15,17** 
2.68 . 

15.71** 
,2.66 


-.44* 
4.76 

-1.27* 
5.31 


-.02* 
5.29 

1 . 28* 
5.54 



TABLE II 





n 




CE 


RO 


AC 


AE 


AC-GE 


AE-RO 


ncca-ing WEEKDAY 
tucents, Fall, 1977 


201 


Mean 
S.U. 


15.76+ 
2.54 


15 . 20*-w^ 
3 . ' 5 


15 . 31*** 
3.33 


15.17 
2.68 


4.76 


- . cr2*^'* 

5.2? 


EEKDAY Graduates, 
pring, 1978 


60 


Mean 
S.U. 


15.02+ 
2.90 


12. 33*** 
3.59 1 


17.48*** 
2.80 


IS 77 
2.98 


4.83 


3.43*** 
5.97 . 


1 






TABLE III 






•- 




GROUP 


rt 




CE 


RO 


AC 


AE 


AC-CE 


/ 

AE-RO 


Intering WEEKEND 
tudents. Fall, 1977 


267 


Mean 
S.D. 


16.36*** 
2.91 


14.43*** 
3.71 


15.09*** 
3.34 


15.71 
2.66 


-1.27*** 
5.31 


1.28** 
5.54 


^:EKDAY Graduates, 
pring, 1978 


60 


Mean 
S.D. 


15.02*** 
2.90 


12.33*** 
3.59 


17.48*** 
2.80 


15.77 
2.98 


2.47*** 
4.83 , 


3.43** 
5.97 




TABLE IV 








GROUP 


n 




CE 


RO 


AC 


AE 


AC-:.E 


AE-RO 


Intering WEEKDAY 
tudents, Fall, 1976 


211 


Mean"*^ 
S.D. 


15.75 
3.22 


14.59*** 
3.09 


15.56*** 
3.29 


15.71 
2.79 


- .' 18*** 
5.43 


1 .12** 

4.90 


WEEKDAY Gr/i'luates, 
||-ing, 1978 


1 60 


Mean ^ 
'S.D. 


'• 15.02 
2.90 


12.33*** 
3.59-_ 


17.48--** 
' 2.80 


15.77 
2.98 


2.47*** 
4.83 


•3.43** 
5.97 






jj ■ 



I ^Column comparison significant: p <:..05 

[^•*Column comparison significant: p<.01 p 

O 3luirji comparison significant^ p<.001 i 

ERJCDlumn comparison significant: p<.057 .255 ^ p 



LEARNING STYLE INVENTORY (LSI) RESULTS: LONGITUDU'AL 
COMPARISONS OF VARIOUS GROUPS OF STUDCTS AT ALVERNO COLLEGE 



• V 



GrouD 



Entering WEEKDAY 
Students, Fall, 
1977; Retested 
Fall, 1979 



Entering WEEKEND 
Students, Fall, 
1977; Retested 
Spring or Fall, 
1979 



\ ' 

] 



CE 



1977 1979 



197^ 1979 



101 1 :^e.;. 15.48 
S,D. 2.56 



1.5,2} 
.2,61 



15,07 13.53 
3.41 3.39 



tt 



Hean 
S.D, 



16.15 
-2.94 



++ 
15.41 
3.15 



AC 



1977 1979 



AE 



1977 1979 



15.60 17.39*='' 
3.29 3,33 



15.44 
2.71 



15. 2r 

3.44 



m 

14.50 12.79 14,99 ]6.09** 
3.80 3.80 3.14 3.69 



AC-CE 



1977 19/9 



,13'' 2.16=^ 
4,63 5.16 



15.79 16.07-1-1.17^ .68* 
2.65 3.34 5.14 6.16 



AE- 



1977 1979 



+ 

,37* 
5.39 



+ 

1.67* 
6,10 



TTT TTT 

1.29* 3.29* 
5.63' 6.38 



TABLE VI 



Group 






CE 


RO 


AC 


AE 


AC-CE 


AE-RO 




1976 1978 


1976 ' 1978 


1976 1978 


1976 1978 


1976 1973 


1976 1978 


Entering WEEKDAY 
Students, Fall, 
1976; Retested, 
Faiy 1978 


83 


''ean 
S.D. 


15# 14.6/"^ 
3.21 2.97 


■ + 1 
14.1.1 13.16' 

2.93 2.86 

■ 


15.49 17.87 
3.64 3.26 


+ + 
16.17 15.42 

2.64 2.70 


-■41 3.19 
5.91 5.56 


2.06 2,27 . 
4:70 4.56 




+ Row coniparisjn significant: 
++ Row cooparison significant; 
28^ y -Hi Row comparison significant: 

ERIC 



Is. 05 
.,01 



•'■ Column comparison significant 
Column comparison significant 
-w- Colutiin comparison significant 



P<.C5 
P^.Ol 
p<.001 



1 1 AKNIN'f .Sl VJ I- I'ROi ll.l'. 
^^.»rI1l^ lor thf I r.uninj^. ^t\W Invrntnrv 



l.LAKNINC, STYLE TYPF. GRID 



Cone rule 



... V^EEKOAY 
WEEKEND 
^ GRADUATES 



CONCRETE EXPfniENC 



Attive , / 
rtmcnt4tinn 




Abstr.ict 
t i>ntt'ptu,ili;'jliun 



FIGURE 1 CttCSS-SECllONAL COMPARISON OF ENTERING WEtKDAY AND weKKEND 
STUOCNTS 119771 AND WEEKDAY GRADUATES l197fl). 
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0 WEEKEND , 
^ QRADUATESt; , 



RtFLtCTiVt 
OWCRVATION 



II .J J 2 * 



Assinitl.il'ir 



AC-CI. 

ABSTRACT CONCCPTUAUZATIOM 

FIGURE 2. CROSS-StC^IONAL CDMPARISO^• OF FNTRRING W£EKOA% ANO tVEEKE*ID 
SIJDENTS ft977t AND V^EBKDAV GRADUATES 0878). 
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\ FARNING STYLL TYPf GRiO 



100' - 



ACTIVE 
E'X^RIM£NTATtON 



FIGURE 3. tONGtTUDlNAL COMPAfilSON OF CATERING WEEKDAY STUDENTS (1977). 
DETESTED TWO YEARS LATEf. 0979). 
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FinUHE 4. LONGfYUDtNAL COMPARISON £NT*^5»!^x^ WEEKDAY STUDENTS WVTh 
RETiirrEO TWO VEA«^S LATEh (I978i. 



Piihlnhcd by Mf5f r ana Cofnp«nv 



I f ARNiN(, siYi.f- rYfM:(-;Kn'"> 



Ni TIP ^ tni tlir I r.irrunj; Sivit' lnvt'nli»rv 
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1? 




STUDENTS TWO YEAR^ 




10 




LATER. 1079 ^ 
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AC T 1 VE 






REFLECTIVE 


eXPCRIMENTATION 






OMERVATIOI 


isni- u )(> ~ f. 
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u 








i: 








15 










t 


V ^) 10 












AC 





ABSTRACT CONCEPTUALIZATION 



FIGURE 5 LONGITUDINAL COMPARISON OF ENTERING WEEKEND STL'DENTS (1977), 
RiETESTEO TWO VEARS LATER 11979) 
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FIGURE 6. LONGITUDINAl COMPARISON OF ENTERING WEEKEND STUDENTS (1977). 
RETESTED TWO YEARS LATER (19791 
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FIGURE 7. tONOITUDINAL COMPARISON OF ENTERING WEEKDAY STUDENTS (1978) 
RETfSTED TWf, vEARS tAT£R (1978) 
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FIGLlRE 8. LONGITUDINAL COMPARISON DF ENTERING STUDENTS (1978) RETESTCO 
rWD YEARS I ATER (1978). 



Co^yyPKbt*' David A Kolb, 1976 
PuNlih«d by MclWf *nd Company 
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A Note to Participants Entering Alverno in 197b on 
Results from Their College Group 
on the Learning', Style Inventory 



Dear Participant, 

You are part of tlic longitudinal participant ^raup wtio entered Alverno in 1976 , 
and you contributed time to our evaluation study of college outcomes in 1976,^ 
1978 and 1980. The following materials on the Learning Style Inventory describe 
the meaning of the inventory, cautionary notes on how not to interpret group 
results in relation to your individual profile, and our results from large 
numbers of students completing the inventory during the last five years. 
In th-.s note, 1 would 1 ike ^to direct your attention to .^ome more recent results 
describing cl^anges in your *class as it progressed through college. The attached 
figures and table illustrate my comments. 

First, it is clear that as a group, your class made significant changes in 
preference for learning style during the first two years in college. As a 
group, your class maintained these preferences during the last two years of 
college', and show no statistically significant changes from the time your class 
completed the inventory in 1978 and again in 1980. Naturally, group differences 
should not be used to predict or explain your individual profile. Any one person 
may show quite different patterns from the overall group picture. 

One reason we may see changes in learning style preferences in the first two 
years of college and not during the last two years is that ths measure is 
an indication of preferences . During the first years in college, students 
as a group mav change their preferences to reflect the variety of ways of 
learning they are experiencing, and students enhance their understanding of 
the reasons they often choose a number of approaches to learning rather 
than just one or two. As a group, college students may express this value 
for using various learning styles, and this preference shows up as almost 
equal preference for each learning Style on the LSI. (Naturally, individual 
profiles will look quite different from this overnl ' group result.) 

It may be that during the last two years of college, students more likely express 
their preferences for various learning styles by actually trying them out m 
learning both on and off campus. However, the Learning Style Inventory does 
not measure learning style behavior. It can only measure preterences. The 
Inventory would not be able to measure whatever behavioral changes are taking 
place in the group as a whole^ during the last two years. 

Our next step is to look at patterns of change in individual differences in 
learning style. This may shed further light on the ways in which preferences 
change or do not change during the last two years in college. We also need 
to look. closer at the LSI data from students in particular majors. We plan 
to begin that analysis this summer, since we can now begin working with cur 
complete set of data, including LSI profiles from students who entered Alverno 
a year after you did and who just completed their last assessment. 
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will he. stM). : a^i, y ^.i moro reports in Liu- i 
inf ormat: ion on both your own individual proii 
oi' interi^st:. 



J luw, I trust this 
d group results will be 



Sincerely , 

Marc ia Mentkowski 
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Longitudinal Comparison of Weekday Students Who Entered in 
Fall, 1976 and Rewrote the Learning Style Inventory (LSI) in Fall, 1978 and Spring, 1980 



GROUP 


n 




CE 


RO 


Ar 




AC-CE 


AE-RO 


Entering Weekday 


57 


MEAN 


15.81 


14.44 


15.40 


15 


63 


-.40 


1.19 


Students, Fall 1976 




S.D. 


3.09 


2.86 


3.73 


2 


62 


5.79 


4.58 


Retested, Fall 1978 




MEAN 


14.42 


13.32 


17.77 


15 


28 


3.35 


1.96 




S.D. 


2.93 


2.88 


3.48 


2, 


,81 


5.80 


4.63 


Retested, Spring 1980 




MEAN 


14.33 


13.49 


17.81 


15 


33 


3.47 


1.84 




S.D. 


2.90 


2.93' 


3.69 


2 


67 


5.82 


4.69 
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(See reverse side for graphs.) 
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I.EAKNI\C;bni,l:!'ROH[i. 



XornMortlicLwrningSlvlt'lna'ntorv 

Concrds^ zavoa entering students, 1976 WNCRETE EXfERlENCE 




AMTflUa CONCEPTUALIZATION 



FIGURE I LONGITUDINAL COMPARISON OF ENTERING WEEKDAY STUDENTS |197fl| LONGITUDINAL COMPARISON OF ENTERING STUDENTS 119761 

RETESTEO IN FALL 1978 AND SPRING 1380. rETESTED IN FALL 1978 AND SPRING 1980. 
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A Nolo Lo Pari i c i [)aiit.s Entering Alverriu in 1977 on Result!-; 
fruiii Their Collep.o Group on the hcarning Style I rr 



Dear Partieipant, 

You are part of the longitudinal participant group who entered Alverno in 1977, and 
you contributed time to our evaluation study of college outcomes in 1977, 1979 and 
1981. The following materials ou.--the Learning Style inventory describe the me.iaing 
of the inventory, cautio!iary notes on how not to interpret group results in relation 
to your individual profile, and our results from large numbers of students completing 
the inventory during the last five years. In this note, 1 would like to direct your 
attention to some more recent results describing chaises in your class as it 
pro ,ressed through college. The attached figures and table illustrate my comments. 

First, it is clear that .iS a group, your class made significant cU<inges i fi i)refer- 
ence for learning style during the first two years in college. As a group, yoi.r 
class maintained these preferences during the last two years of college, and show 
no statistically significant changes from the time your class completed the 
inventory in 1979 and again in 1981. Naturally, group differences should not 
be ufied to predict or explain your individual profile. Any one person may show 
quite different patterns from the overall group picture. 

One reason we may see changes in learning style preferences in the. first two years 
of college and not during the last two years is that the measure is an indication 
of preference's. During the first years in college, students as a group may change i 
thei r"pre"fe~rl^nces to reflect the variety of ways of learning they are experiencing, 
and students enhance their understanding of the* reasons they often choose a number 
of approaches to learning rather than just one or two. As a group, college students 
may express this value for using various learning styles, and this preference shows 
up as almost equal preference for each learning style on the LSI. (N;itnr,iilv 
individual profile: ■ ' ^ >ok quite different from this overall grc 

■4. 

It may be that during the last two years of college, students more 
their . preferences for various learning styles by actually trying tlicm <uiL ui 
learning both on and off campus. However, the Learning Style Inventory does not 
measure learning style be havior . It can only measure preferences. The Inventory 
would not be able to measure whatever behavioral changes are taking place in the 
group as a whole during the last two years. 

Our next step is to look at patterns of change in individual differences in learning 
style. This may shed further light on the ways in which preferences change or do 
not change during the last two years in college. We also need to look closer at 
the LSI data from students in particular majors. We plan begin that analysis soon 

sending you more reports in the future. For now, 1 trust this information 
on both your own individual profile and group results will be of interest. 



Sincere ly , 




Marcia Mentkowski 
Di rect > ■ ^ va 1 uat i on 
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LGfKjilijdliiiil CDiiiixirisiiM of Siiirlenb, [mered and duiiipletcd llie Leariiiiiy Style Inventory (LSI) 



1 ' I lull I ..'t : ) 1 ' 



T/'-Bif; A' WFia^ SIUDEN!". 



Civ 



AC 



AH 



AC-ct: 



' i^79 1931 i 19"// 14/^1 1581 1 Wl m 1981 197/ 1975 19«1 19^7 l'^?^ M 



Ifikinal ) Intend 2 ' InU'r^jl t In^'Wfil 2 ' Interval 1 iMirvil 2 int^rvi) I lnttrv«l 2 



L'nh-ririi'. <)ivl 
ti,'4K| i:! 
ulJ 1^177, 

ail 1979 Mi\ 
Sjiiin,; b'SI 



s.i). I ,*.:)8 J. 



l;.i)i) \SM 
l.n irr ]M 



^/)9 ',).')'■ 'i.v; 



AE-RO 
1977 1979 1981 



0.11 1.6f) 1.(18 
6.19 U! 



i.-roup 



CE 

Intinill 

m im m 



iiitoriii); 
tested in 

and retestod in 
Fall l<i;'J ,iiid 
Sarliii; [%] 



AC 



Inunill"" Inl(r_ni2 I InKrViH" lniirvjIZ^ 

19?7 ■ Wi m\ 1 197/ l'7'/9 1981 
I 



!f.,).' ii,ii8 1 i.'.'i r/,:'i 



i',,:''i ri.'Ki i(),M 



],W 'J.Vi ■ 3.6i 'i.)] 



IntiiYiM 

197; 1979 1981 



AC-CE 
Intmill" In|in(il2 

1977 1979 1981 



\'>M Ifi.fll U.fifi I -?,07 (1,1,, i.Vj 
2.)5 ],71 ]X> \ 6,21 'i.O'i 



1977 1979 1981 

n.2H ),28 'i.j'i 
i.M 6,95 b.iW 
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LEARNING STYLE PROFILE 
Norms for the Lwmiiij; Style Inventory 

Concrete. 
Experienci. 



LEARNING STYIETYPE GRID 



FALL 1977 

******** FALL 1979 
SPRING 19B1 




Active 
Experiments 

H 20 11 
to PMHI 



Reflktive 
Observation 



Abstract 
Conceptualization 

FIGURE A; LONGITUDINAL COMPARISON OF WEEKDAY STUDENTS WHO ENTERED IN 
FALL 1977, RETOOK THE LSI IN 1979, AND SPRING 19111. 



CopyrigtifDa\idAKolb,l976 
PublishPiibvMcMfandCiippjnv 
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® FALL 1977 

♦ FALL 1979 
\ J SPRING 1981 




iiiO W jO 



AC-CE 



« » ffl 10 n 

' PlttfWllft 



fIGUREB; 'ONGITUOINAL COMPARtWN OF WEEKDAY STUDENTS WHO ENTEflED IN 
FALL 1977, RETOOK THE LSI IN 1979, AND SPRING 1981, 



Copyright* David A. Kolb, 1976 
Published by M.'Ber and Company 



LEARNING SniE PROFILE 
Norms for the Learning Style Inveiitorv 

'* Concreto 
' Experience 



LEARNING SmETOECRlD 



FALL 1977 



■"^ lAdive 
Exptlriment 



10 




FALL 1979 



SPRING 19B1 



14 SM" 



Reflective 
Obseivation 



Abstract 
Conceptualization 

FIGURE C: LONGITUDINAL CWARISON Of WEEKEND STUDENTS WHO ENTERED IN 
FALL 1977, RETOOK THE LSI IN 1979, AND SPRING 19G1. 



® FALL 1977 
♦ FALL 1979 

n SPRING 1881 
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FIGURED; 'lONGITU'DINAL COMPARISON OF WEEKEND STUDENTS WHO ENTERED IN 
LL 1977,RETOOK THE LSI IN 1879,AND SPRING 1981, 



Copyrijslit'^DavidA.Kolb, 1976 
Published by McBer and Compjny 
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Acconwfodator (AE, CE) 

> Ability to carry out 
plans, action oriented 

> Likes new experiences, 
a' risk-taker 

> Adapts to immediate 
circumstances 

> Intuitive, trial-and- 
error style 

> Characteristic of people 
with backgrounds in prac- 
tfcal fields like business 



ro 



FOyR LEARtlllG MODES 
fli'TflElli CORRESPOilUe LEI1RIIIN6 STYLES' 




Concrete 
Experience (CE) 

* Experience-based 
approach tq learning 

• Feelin^-bas^.d judgments 

' People oriented 



Active 

Experimentation IhE} 

(} 

♦Active /-doing approach 
to learning . 

i Involvement with activities 
', -thait'^test one's own 
■ Vkno wledge and ability ' 




LEARNING 



Ms 



3fc 



Converger (AC, AE) 

> Good at practical 
application of i^m 

> Does well in situations , 
where there is one answer 
to a problotn, e.g», , 
conventional IQ tests 

> Unemotional, prefers 
, things to people 

-> Narrow technical interests 

> Characteristic of 
engineers ^ 




Reflective 
Observation (RO) 

Tentative, inipartial; 
reflective approach to 
learning 
• Preference for role of 
observer rather than 
participant 



abstract 

Conceptmlizdtion f/lCj 

' Analytic approach 
to learning 

• Logical, rational 

• Orientation towards 
thin gs and symbols 




-^^^ jpted frora o/Vid A. Kolb, "learning Style 
TnuPTifnri^ Self-DfiBcilDtion of Preferred 



Diverger (RO, CE) ■ 

> Imaginative ability, good 
-at generating ideas, 
"brainstorming" 

> Can view a situation 
from many perspectives 

> Emotional, interested in 
peopl'e 

> Characteristic of people 
with backgrounds in the 
humanities or liberal arts 

> Characteristic of counse- 
lors, personnel managers, 
organizational development 
specialists 



Assimilator (AC, RO) ^ 

♦ 

> Ability to create theoret- 
ical models 

> Inductive reasoning 

> More concerned witfi concepts 
than people, but less 
concerned with practical use 
of theories 

'> Characteristic of people in 
the basic sciences and those 
in research and planning 



-m 

AlJ|no College 



A 
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APPENDIX G . . ' 



Alverno College 



April 17, 1978 



Dear student. 

You may recal 1 that when you entered Alverno in the 
fall of 1977, you participated in a series of long-range 
inventories. The purpose of these inventories is to es- 
tablish validity of the Alverno College degree. Last fall, 
you were promised feedback on these inventories as it be- 
came available. 

One of these inventories, the Learning Style Inven- 
tory, has been scored. Enclosed are your results, along 
with an explanation of your scores. This information was 
presented to many students during "Feedback Sessions'* in 
various classes this spring. Because you were not in at~ 
tendence at one of tnese sessions, we have decided to 
send you your feedback by mail. 

Thank you for your participation last fall. We hope 
that this information will provide you with an additional 
tool to use in the many learning situations you will en- 
counter in the upcoming years. 




Ma r c i a Men t kows k i 

Direct r Office of EvaluaLion 
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Alverno College 



April 20. 1978 



Dear student, 

You may recall that when you entered Alverno in the 
fall of 1977, you participated in a series of long-range 
inventories. The purpose of these inventories is to es- 
tablish validity of the Alverno College degree. Last fall, 
you were promised feedback on these inventories as it be- 
came avai lable . v-f 

One of these inventories, the Learning Style Inven- 
tory, has been scored. Enclosed are your results, along 
with an explanation of your scores. This information was 
presented during the first Week End College session in 
January. Because you were not in attendence at this 
session, we have decided to send you your feedback by mail. 

Thank you for your participation last fall. We hope 
that this information will provide you with an additonal 
tool to use in the many learning situations you will en- 
counter in the upcoming years. 




, Marcia Mentkowski 
Director, Office of Evaluation 



r. 



301 



268 



ERIC 




APPENDIX H 



Alverno College 



May 5, 1978 



Dear graduating senior, 

I wish to take this opportunity to thank you for your contribution 
to the study funded by the National Institute of Education that you par- 
ticipated in this semester. T have been extremely gratified by the 
professional responsibility demonstrated by you and the other graduating 
seniors. 

I promised to mail your feedback on the Learning Style Inventory 
before graduation as part of my continuing cotnmitment to you to apprise 
you of outcomes of the study that may be of benefit to you in your future 
professional development. The Learning Style Inventory is one of the 
inventories you completed that we expect will contribute to the validation 
of the Alverno degree, and to this study of women's perspective on pro- 
fessionalism and personal development. I expect that feedback on your 
score will assist you in interpreting and understanding your preferred 
learning style. 

Your results are enclosed. I have also included several explanatory 
pages describing the theoretical base for the inventory. Instructions 
for interpreting the Learning Style Profile and several tables describing 
comparisons on the inventory for several groups are also included. 

Additional feedback on the other inventories and research results 
will be mailed to you as soon as it becomes available. Keeping your 
address current with the Alverno Alumnae Association will assist me in 
mailing other information, and in contacting the followup study groups in the 
spring of 1980. Since we do have your permanent address, I expect that 
we will be able to reach you with feedback there. 

Again, your contribution has made this work possible. I thank you 
and congratulate you on your graduation. 



Best wishes for the years ahead. 




Marcia L. Mentkowski, Ph.D. 
Associate Professor of Psychology 
Director of Evaluation 
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LEARNING STYLE INVENTORY INFORMATION : GROUPS AT ALVERNO COLLEGE 



LEARNING STYLE PROFILE 



Active 
Experimentation 



■24 20 19 




Reflective 
1 Obsei^atiJ 



Abstract 
Conceptualization 
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LEARNING STYLE PROFILE 



number of 
persons 
in group 



CODE 



Concrete 
Experience 



:t3 and Humanities 
ihavloral Sciences 
tucation . 
iturai Sciences 

and Mathematics 
irslng 

irformlng Arts 



/Active 
ixperimentdtion 



Reflective 
Observation 
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LEARNING STYLE TYPE GRID 



MAJOR 



number of 
persons 
in group 



CODE 



IVrceniiles 
0 H 



10 



30 - 



40 



O 

< 



60 



70 - 



80 



-12 
-10 
-8 

-7 
-6 

-5 
-4 



Accommodator 



-3 - 



-1 - 



0 - 



Arts and Humanities 
Behavioral Sciences 
Education 
Natural Sciences 

and Mathematics 
Nursing 

Performing Arts 



2 
6 
6 
2 

32 
10 



7 15l3i:^ 11 10 9 8 



5 • 4 



4- 



Converger 



100 



I - 

HO 



•t - ■ 

70 



« 

10 - 
11 

12- 
13 
14- 
16 

18^ 



60 



40 



Diverger 



Assimilator 



t t ) ) i 

-5-6-7-8-11 



30 



20 
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LEARNING STYLE TYPE GRID 



Percentiles 
0 -i 



10 - 



20- 



30 - 



40 - 



bO - 



70 - 



80 - 



Accommodator 



■f i' t -4- — -f + ■ 

151312 11 10 9 8 



f f- 

7 6 



Converger 



-12 -I 

-10 
-8 

-7 
-6 - 

-5- 
-4- 

-3" 
-2- 



-1 t' 



Seniors 

Arts and Humanities Faculty 

Nursing Faculty — — 
Social Science Faculty — 

Natural Sciences/Math Faculty— ;^—x-X 

Freshmen (Weekend)/^ 7^ T** 7^ 
Freshmen (Weekday ) .m.^^^. 



100 



-1 ~ 

90 W) 



Figure 4 
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Assimilator 



20 



AC-CE 



10 0 
Percentile's 



Mean Type for Faculty , Seniors (Spring, 1978), 
and Freshmen (Weekend and Weekday, Fall, 1977) 
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Alverno College 



September 13, 1978 
406 Corona Hall 
telephone Ext. 412 



Dear (student's name): 



We have been contacting students regarding their 
participation in completing a series of inventories. 
These inventories are part of Alverno 's effort to 
demonstrate the validity of the competences and abil- 
ities that lead to your capability as a professional. 

The following arrangements have been made for your 
participation : 

Friday, September 15 12:30-3:30 pm Kellogg A 



Friday, September 29 12:30-3:30 pm Kellogg B 

Please plan to attend both sessions. Thank you so much 
for your cooperation. We will be expecting you on September 



and 



15. 




Marcia Mentkowski 
Director of Evaluation 




S. Rosemary Hufker 
Chairperson of the Education 
Division 
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Alverno College 



October 25, 1978 



Dear (Student's name) ^ 



I am writing to re-introduce you, as a nursing student, 
to the research being done here at Alverno on women profes- 
sionals, Including nurses. Dr. Marcia Mentkowski is directing 
'a project that looks at women's perspectives on learning and 
at changes in these perspectives that might occur during the 
years spent in college. 

The Division of Nursing is very excited about this pro- 
ject and is giving its full support to this important work. 
The insight gained from these efforts will be invaluable in 
improving the nursing program at Alverno, and in providing 
the best possible guidance for our students toward their 
goals as professionals. 

Dr. Mentkowski will be meeting with students individually 
to explain these efforts in greater detail. Mary Schneider 
will be contacting you in the near future to arrange for a 
fifteen minute appointment. 

Thank you for your contribution. 



Cordially. 




Vivien Deback, Chairperson 
Division of Nursing 
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Alvern9 College 



OFFICE OF EVALUATION ^pril 11, 1979 



Dear Graduating Cenior of the Weekend Coljege, 

First, let me congratulate you on becoming a member of the first graduating class from the pioneering 
Weekend College. I recall welcoming you to that first weekend in the Fall of 1977 when you contributed 
to the college by completing a series of inventories. I will be there on May 13 to add my best wishes 
when we gather to mark your remarkable achievement. 

One characteristic of the Weekend College women is that they tend to suggest ideas that we have not 
thought of yet, and I am writing this letter because one of you did just that. Lastfall during a feedback 
session to you I reported on the current progress of the outcomes from the National Institute of Education 
grant, and the current status of our work on the inventories you completed when you'began college here. 
I noted also that I wished to conduct a "midpoint assessment" of students entering in the Fall, 1977 
after they had completed two years at Aiverno. The date for this midpoint assessment is scheduled for 
Fall, 1979. This semester, one of you pointed out to me that there would be a number of students gradu- 
ating this spring, and if I wanted you to have the opportunity for a re-assessment, I had better contact you 
now! 

The purpose of this letter is to desc^Pibe this "midpoint assessment" and to enlist your cooperation in 
completing it. I pfan to call each of you personally to discuss your schedule with you and to find a time 
or times when you would be available. 

• What is a "midpoint assessment?" 

When you entered Aiverno in the Fall of 1977, you com[Dleted a number of inventories designed to 
assess the outcomes of the Alvemo College experience, and to establish the validity of abilities learned 
during your college career for later success. In the beginning of the January, 1978 semester, you completed 
the remaining inventories. When you did so, you were contributing to the evaluation objectives funded by 
the National Institute of Education designed to insure that the curriculum was meeting student needs by 
developing their capabilities in ways that would assist them professionally. We want to show that women 
can achieve in a weekend time frame, even though they, are handling multiple responsibilities. 

• What feedback will I receive? 

As feedback on your contribution, you received your score on the Learning i^.yle Inventory in a group 
feedback session with me. In the Fall of 1978,1 met with you again. I reported progress on all of the 
objectives, including the nursing and management professional studies, as well as some of the early research 
results on some of the inventories. You will continue to receive feedback on the research results. Since 
last fall, we have been working to "score" the remaining inventories. Our consultants in Boston, McBer 
and Company, discussed their progress with us in December, 1978. They have decided to "rescore" all 
inventories using better defihed.criteria because of new understandings that they had reached in defining 
the competences measured by some of the inventories. They are currently working to complete the 
analysis, and we will send you the results when they are available. 
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Following reassessment, this spring, you will receive both your Fall, 1977 Learning Style Inventory 
profile scores and your current profile scores. We will compare the scores and show changes over time. 

When results from the other inventories become available, you will receive reports describing the 
findings. 

• How will the results be used? 

The results of this work will be used in four ways: to demonstrate the effectiveness of the Alverno 
learning process, to contribute to research in higher education, to improve instruction, and most impor- 
tantly, to provide feedback to you on your personal and intellectual changes. Another important contribu- 
tion will be to provide a comparison between the achievements of women who attend college immediately 
after high school, and women who attend college after some time has passed. In order to insure confiden- 
tiality code numbers are used on all inventories. 

I will be calling you within the next week to discuss your schedule with you and to answer any ques- 
tions you may have about this important work. 

Graduating classes often leave a memento for those who come after. They plant a tree or give a piece 
of art work. I can think of no greater legacy for you to leave for those who are aspiring to be like you, 
than to create a record of what you as a class are like: ybur perceptions, your future goals, your hopes, 
and most important, how you have changed. Alverno Collfege has always held the contributions of its 
students in high esteem. This is the beginning of our future relationship with you. 



Cordially, 




Marcia Mentkowski, Ph.D. 

Director of Evaluation 

Associate Professor of Psychology 

MM/bj 




Alverno College 



August 6, 1979 

Dear (Student's name): 



I am Writing to commend you on your contribution to, the important 
work being conducted by Dr. Marcia Mentkowski on the outcomes of-'the 
college experience. .1 have just read . a copy of the report she is sending 
to you, which is attached to this letter. This is indeed an exciting 
prSiect and as a contributor you have already demonstrated a commitment to 
research that will benefit not only you as a studet\t, but other ^students 
as well Your participation not only increases the stature of your Alverno 
degree, but it will also enable the professionals you work with in the future 
to have greater confidence in your capabilities as a colleague. 

All of us in the Nursing Division are very enthusiastic about this 
project and are giving our full support to this work. The insights we 
gain from this sr^udy of the validity of outcomes of the Alverno, experience 
will be invaluable in improving the curriculum at Alverno and in providing 
the best possible assistance to you in meeting your goals. 

li ■ 

I am also writing to ask for your continued assistance during the 
upcoming year. I -mderstand that you began your participation -When you 
first came to ALverno in the fall of 1977. At that time you completed a 
series of inventories that assessed your initial capabilities in a number . 
of areas which are expected to. relate to future professional performance. 
Feedback on one of these inventories, the Learning Style Inventory, was 
presented to you by Dr. Mentkowski in your pre-prof essional seminar or by \ 
mlu during the latter part of your first year. In addition Jo continued 
feedback (such as the report attached) you will be receiving further in- 
dividual- feedback on the Learning Style Inventory after your participation 
this year This feedback will show your changes in preference for learning 
style since the fall of 1977. It is my understanding that all of the infor- 
mation from the inventories is confidential and anonymity is maintained 
through the use of code numbers used only by Dr. Mentkowski in her work for 
with you. 

Since this work is an institution-wide effort, the chairpersons and 
■ faculty in all departments have set aside time specifically for you to continue 
your participation now, at the beginning of your third year at Alverno. Your 
ins^.uc^ors will excuse you from classes during the time set aside for your . 
participation, enabling you to complete the inventories as part of your regular 
s-^hool day, rather than contribute time outside of class. In order to insure 
that you will not miss important class time, I have asked your instructors to 
plan the da' with your absence :.n mind. Faculty will not assign aclditional 
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or make-up work for this time. Each of your instructors has been informed of 
your contribution and is being notified of your absence for that time period. 
We have scheduled your participation for the following day: 

Wednesday, September 12 
Kellogg Conference Center 
8:10 a.m. - 2:00 p.m. 

During the day, there will be refreshments available and time for 
breaks and lunch. At the completion of the inventories. Dr. Mentkowski 
plans to rae'et with you to answer any questions you might have, and to 
discuss the attached report in greater detail. She will also advise you 
of when you will be receiving additional feedback about the study. 

You will be receiving another notification prior to the date above. 
Thank you for your assistance in this important work. 



Cordially, 





Vivien DeBack 
Cha irperson 
Nursing Division 

V:):mh 
Enc losure 
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Alvemo College 

August 6, 1979 



Dear (Student's name): 



I an writing to commend you on your contribution to the important v/ork 
being conducted by Dr. Marcia Mentkowski on the outcomes of the college 
experience. I have just read a copy of the report she is sending to you, 
which is attached to this letter. This is indeed an exciting project, and 
as a contributor you have already demonstrated a commitment to research that 
will benefit not only you as a student, but other students as well. Your 
participation will direccly benefit your profession and will not only increase 
the stature of your Alverno degree, but will also enable the professionals 
you work with in the future to have greater confidence in your capabilities 
as a colleague. 

All of us in the Nursing Division are very enthusiastic about this 
project and are giving our full support to this work. The insights we 
gain from this study of the validity of outcomes of the Alverno experience 
will be invaluable in improving the curriculum at Alverno and in providing 
the best possible assistance to .you in meeting your goals. 

I am also writing to ask for your continued assistance during the 
upcoming year. I understand that you began your participation when you 
first came to Alverno in the fall of 1977. At that time, you completed 
a series of inventories that assessed your init;,...! capabilities in a number 
of areas which are expected to relate to future professional performance. 
Feedback on one of these inventories, the Learning Style Inventory, was 
presented to you by Dr. Mentkox^ski during your first year. Also, in fall 
1978 Dr. Mentkowski talked with you about the outcomes and benefits of 
the study. In addition to continued feedback (such as the report attached) 
you will be receiving further individual feedback on the Learning Style 
Inventory after your participation this year. This feedback will show your 
changes in preference for learning style since the fall of 1977. It is my 
understanding that all of the information from the inventories is confiden- 
tial and contributed anonymously through the use of ..code numbers used only 
by Dr. Mentkowski in her work with you. 

Since this work is an institution-wide effort, the chairpersons and 
faculty in all departments have set aside time during orientation specifically 
for you to continue your participation now, at the beginning of your third 
year at Alverno. 
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We have scheduled you to participate on 

Saturday, August 25 
Kellocg Conference Center 
*a:15 a.m. - 3:30 p.m. 

During the day, there will be ref reshme:nts available and time for 
breaks and lunch. At the completion of the inventories, Dr. Mentkowski 
plans to meet with you to answer any questions you might have, and to 
discuss the attached report in greater detail. She will also advise you 
of when you will be receiving addition?! feedback about the study. 

Thank you for your assistance in this important work. 

Cordially, 



Vivien DeBack 
Chairperson 
Nursing Division 

VD:mh 
Enclosure 

*\OTE- These students who are enrolled in N140 or N190 can begin the 
inventories after class and will be rescheduled to complete the inven- 
tories at a later date. Students enrolled in LA003 can participate in 
the morning and will also be rescheduled for completion at a later date. 
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ALVERNO COLLEGE 
OFFICE OF RESEARCH AND EVALUATION 



UNDERSTANDING THE DEVELOPMENT OF THINKING IN COLLEGE 



SECOND REPORT TO PARTICIPANTS IN A 
LONGITUDINAL STUDY OF COLLEGE OUTCOMES 



Marcia Mentkowski 



Funded by a grant from the National Institute of Education: 
Careering After College: Establishing the Validity of Abilities 
Learned in College for Later Success 
(NIE-G-77-0058) 

Principal lnvesti9ators: 

Marcia Mentkowski 

Austin Doherty 

Alvemo College 

3401 South 39th Street 

Milwaukee, Wisconsin 53215 
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Alverno College 
Office of Evaluation 



A PROGRESS REPORT TO PARTICIPANTS 
CONTRIBUTING TO THE STUDY FUNDED BY THE NATIONAL INSTITUTE OF EDUCATION 
ESTABLISHING THE VALIDITY OF THE OUTCOMES OF THE COLLEGE EXPERIENCE 

The purpose of this report is to provide you with information and results of 
the study you have contributed to and to extend our invitation to you to 
participate again this year. 

One of the iinpurtant responsibilities I have as director of the study is to 
disseminate information as it accumulates, rather than to wait to the end 
to present findings to you. I also wish to convey the significance of the 
work to you and to your future as student, as alumna, and, most importantly, 
as a professional. 

I am also interested in what ^ou may have to say about the results. What 
meaning do they have for you? At the end of the scheduled inventory 
collection day, I will be holding a special session to meet with you 
to discuss issues and questions you may have about our mutual effort. 

PROGRESS 

A little over one-half of the three-year grant period has passed, and we have 
now collected much of the information that will be the basis for our final 
reports. This third year, 1979-80, is a crucial year for the remaining data 
collection. It will be our first opportunity to study our graduates, 
specifically f^itB. students who graduated in spring, 1978. We will collect a 
midpoint ass^sment of our second longitudinal group (students who entered 
Alverno in fall,= 1977) and the final assessment of our first longitudinal 
group (students who entered Alverno in fall, 1976). We are currently 
interviewing our last group of professional nurses for the professional 
studies; we are beginning to set interviews with professional women managers. 
These studies, as you may recall, will be used to validate Alverno s 
professional programs. 

This will be an important year—a year dependent on you if we are to be 
successful in our goal of validating the outcomes of the college experience. 
For now, I want to share with you some of what we know so far— the results 
that justify and encourage continued work with the inventories. 

UNDERSTANDING THE DEVELOPMENT OF THINKING IN COLLEGE 

For thi-s report, I will tie the research objectives together around a single 
concept: Thinking . I will be interpreting results that help us to understand 
the development of thinking by referring to a number of different inventories 
that you have completed as well as to ideas shared with us by practicing 
professionals. Our various objectives approach thinking in different ways, 
using different terms. These terms are: 

I. ANAJ.YSIS 

II. COGNITIVE STRUCTURE 

III. PERSPECTIVE-TAKING 

IV. ABSTRACT CONCEPTUALIZATiqN 

Op ) 

V. CONCEPTUALIZING OCU 
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Our objective of understanding "thinking" is one to which ail of you liave 
contributed. We have results from two comparisons made possible by 
contributions from seniors and entering students (mostly freshmen) who 
completed inventories. We have results from the first longitudinal sample: 
students who took the inventories in the beginning of their first year at 
Alverno (1976) and who completed the inventories two years later—at the 
beginning of their third year. We can also look at the Weekend students, whose 
life and work experience add another dimension to student development. You 
have participated in completing the series of inventories and we are inviting 
you to do so again during the coming year. 



ANALYSIS 



Analytical capability is one of the eight competences which provide the frame- 
work for the Alverno educational process. We feel that it is vitally important 
CO continue to develop our understanding of this ability. 

One of. the inventories that is designed to assess analytical capability is 
the Test of Thematic Analysis developed by David Winter. Winter feels 
that standardized tests, objective tests (including multiple choice) and 
grades do not adequately measure the ability to analyze. His inventory assesses 
the ability to create and communicate modes of analysis by asking the student 
to discover and discuss the ideas and themes in two groups of paragraphs 
about a man working alone at his desk. 

Our cross-sectional comparison of entering freshmen and graduating seniors 
on this inventory shows that there have been significant changes in student 
performance on this inventory— changes which indicate that cognitive complexity 
and the ability to analyze is developing in Alverno students. Because Winter 
and his colleagues are working with this instrument at a number of colleges, 
we will be able to study what is happening at Alverno in the context of other 
institutions. For instance. Winter's earlier work indicated that students 
at a liberal arts college he studied improved in their ability to analyze to 
a greater degree than did students. at both a state teacher's college^ and 
a two-year vocationally-oriented community college. Winter states. Liberal 
Arts seniors were better able to bring confusion and complexity typical of 
everyday life under cognitive control."! 

We believe that our extensive longitudinal data will add another dimension 
to this research— development of analysis at Alverno, a women's liberal arts 
college with a specially designed program focusing on analytical competence 
as one of its objectives. 

We are also interested in investigating whether practicing professionals, 
including .Mverno graduates, identify the ability to analyze as important to 
successful careering. Our study of outstanding nurses, for example, has 
shown that conceptual ability is important and essential. 

The results from your contributions and those of practicing professionals 
combine into an exciting picture of what analytical capability is and how 
it fits into both learning and performance. The more we understand this 
competence, the better we will be able to teach toward it. 



IWinter, D. "Business Leadership and the Liberal Arts." New Jersey Bell Journa 
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I ^ • C OGNITIVE STR UCTURAL CHMGE 

Assumptions about knowledge, the "framework" that a person uses to 
understand her surroundings, are what we refer to as "cognitive structure." 
Several of the inventories you have written look at the ways in which 
cognitive structure changes during coll-^ge. These include Opinions About 
Social Problems (by James Rest after I awrence Kohlberg) , Measure of 
Personal, Educational and Vocational Issues (by Lee Knefelkamp after 
William Perry), and Sentence Completion (by Jane Loevinger) . 

We have found significant changes~I call them "leaps in development" — 
that seem to be occurring as a result of the college experience. And the 
changes are in the predicted direction — after some college, students are 
able to do more complex thinking, using more sophisticated frameworks to 
organize their experiences and to make sense out of a multitude of ideas 
and experiences. 

Interestingly, we are finding that life experiences can assist in the 
development of some of these cognitive structures, but that persons who 
go to college do develop these to a greater extent. For example, on Opinions 
about Social Problems, an inventory that asks the student to check off and 
prioritize the important issues in a story. Weekend College freshmen showed 
more sophisticated thinking than the younger students entering as freshmen- 
in the Weekday College. However, graduating seniors in the Weekday College 
showed greater sophistication in terms of cognitive structure than did the 
Weekend College freshmen, who were eight years older, on the average, 
and had more work experience - 

These are very important findings because they indicate that college does 
offer experiences that lead to more sophisticated cognitive processes than 
do life and work experiences alone. Students and educators have often 
wondered whether it is really any kind of advantage to go to college, or 
if one should seek life and work experiences instead. Our findings indicate 
that college does have a significant effect on some types of thinking. 

I would also like to share with you some of our findings on the Measure 
of Vocational, Educational and Per-.onal Issues. This inventory is designed 
to measure development by looking at the way a person approaches three 
critical issues: learning, decision-making, and career choice . You may 
recall being asked to write about your favorite class, a critical decision 
you recently made, and your career goals. Data from the Weekday students 
(collection of comparable data on Weekend students is planned) suggests 
that approaches to these issues change during the first two years in college. 
Students who have been in college for two years are more likely to see 
many sides to an issue rather than just two, and to see and understand 
multiple points of view. Belief in a "right answer" to all issues gives 
way to coming up with one's own answer, based on one's own judgment and 
utilizing, but not depending upon, the judgments of others. 

It will be important to check these findings with our other longitudinal 
• groups. Those students who will be completing the inventories this year— 
notably those who will be completing them in their third and fourth years- 
will help us to see if there are significant changes for individuals, not 
just groups of individuals. After all , Alverno ' s goal is to assure 
individual development, not simply to summarize group data. 
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III. PERSPECTIVE-TAKING 



Another major goal of the grant proposal is to provide a vehicle for 
students who experience college — and for alumnae who have entered "life 
after college," (I have heard there is life after college)— to describe 
their own perspectives on college and on their post-college careers. 
How do they see the college experience? What kinds of experiences in 
college triggered their own growth and development as women, as professionals, 
and as persons who transfer what they have learned in college not only 
to their work setting, but to their personal life? Do abilities acquired 
in college really assist in personal and professional success? What is 
learning — from the student's point of view? 

We have involved a randomly selected group of students who meet individually 
and share with us, at the end of each year in college, their perspectives 
on these questions. Some initial analyses of these interviews indicate 
that most students do grow in a number of important ways, notably toward 
greater self-confidence in themselves as learners; they begin to take more 
and more responsibility for their own learning. One interesting hypothesis 
we have identified and that we wish to develop further involves the 
integration of a career with a personal life. This seems to become a major 
issue for younger women in college. The more experienced woman also is 
concerned with the issue, but in different ways. We are not sure just how, 
but it seems to us that while a conflict between career and personal life 
may be anticipated and felt by women in their younger years, the Weekend 
women show that there is a resolution to this particular conflict—integration 
of career and personal life can occur. Does that mean there is an end to 
conflict? Probably not. But life and work experience, and the support 
of fellow learners seem to allow consideration of new aspects of the dilemma. 
Experienced women are more likely to take for granted that an integration 
is possible and turn their attention to working on how to do this well. 
Does college help them? This and other questions are being askfed as we 
continue to talk with students and alumnae. 



IV. ABSTRACT CONCEPTUALIZATION 

All of you who participated in the inventories have received individual 
profiles from the Learning Style Inventory. The Weekday students who 
entered their third year in fall, 1978, and the graduating seniors from 
the Weekend College this year have received the most recent results. All 
of you have received this feedback in oral presentations and/or in written 
form. Everyone completing inventories this year will be receiving feedback 
on your individual changes on the Learning Style Inventory shortly after 
completing it. Given all the information we have communicated to you 
(results, graphs, discussions), what can we say about the development of 
Learning Style? What is important about the development of learning 
style and what does it mean? 

Students in college develop a significant preference for abstract concep- 
tua lization , the learning style that involves forming abstract concepts, 
idlas and theories for further testing out in actual situations. Both 
Weekday and Weekend women come in with high preferences for the concrete 
rather than the abstract. Both groups change significantly to prefer the 
abstract. This finding is reinforced by the two year comparison on students 
who completed the Learning Style Inventory when they entered (fall, 1976), 
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and again two years later (fall, 1978). There is also a movement away 
from a dominant preference for reflective observation upon entering college. 
Students seem to prefer the more con^ eptual and active testing out Jpf 
theories after they have experienced some college. 

The most important finding from this inventory is that • students become 
more balanced in their preferences. \Vhat this means to me is that students 
seem to become versatile, to prefer all styles to a degree. I believe this 
is an indicator that you are more likely to use a particular learning 
style according to wl t is called for by the classroom or field situation, 
rather than sticking to a prefere :e despite the contingencies of the 
situation. These results show that changes in college are taking plac^, 
and we tentatively think that there may be patterns in development that 
do lead to increased effectiveness in professional areas — or at least some 
professional areas. We will need further assistance from the seniors who 
graduate in 1980 to really .check out these ideas. They will be the first 
group to provide us with the necessary information so that we can look^ 
at development through the critical field experiences that take place in 
the junior and senior years at Alverno. 
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V. CONCEPTUALIZING 

A second major goal of the grant proposal is to evaluate our curriculum 
objectives in various professional areas by comparing them to the important; 
capabilities identified by practicing professionals as necessary to 
outstanding professional performance in the work setting, vm.ile many 
faculty have had extensive experience in the profession for which they 
create curriculum, they request practicing prof essionals— who accept Alverno 
graduates as future colleagues—to add to or to assist in curriculum 
development. The NIE grant provides the opportunity to do that as well. 
Professionals are interviewed, asked to talk about their work— what they 
actually do-- and then to comment on what they think are the important 
capabilities for professional performance. ^ 

For example, the study of nurses which is currently undergoing its third 
and final phase of data collection, has already provided important insights. 
Nurses with a college degree were found to demonstrate two of the critical 
capabilities that discriminate outstanding performance to a greater degree 
than did the nurses without a B.S.N.- One of these competences is 
"conceptualizing." Nurses nominated as outstanding by their peers, and 
interviewed about their work and what they actually do, conceptualize to 
a significantly greater degree than those nurses who do not have a B.S.N. 
Further, conceptualizing was identified by nurses in the interviews as 
an important competence for performance. We expect that the study of nursing 
competences will be completed during 1980, and that it will then be ready 
for dissemination in its entirety. You may be interested to know that 
the nursing study was conducted in three settings— a nursing home, a 
hospital, and a community health setting—to ensure generalizability to 
the nursing profession. 

Other studies include, as mentioned earlier, the professional woman manager 
and the professional educator. We are using the concept of educator to 
mean an^ person who educates— and our current thinking includes many 

persons who educate outside the context of public or private elementary, „ 

secondary, and higher education. The parent, for example, fits this 
description of educatorl 289 32*4 
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By now, 1 expect you have thought of a number of questions that I have not 
covered here. Good I Every person whc asks a question about our work 
assists us in thinking of new ways to look at the results and in planning 
further work. Questions create meaning. Questionis are* why we are here. 

In order to- facilitate your question-asking, I have arranged for 'you to 
interact with me personally at the end of the i - ^entory participation 
sessions this coming fall and spring of 1980. irhaps you can challenge^ 
us on certain issues; perhaps you would like to know mere about the specific 
results. I would like to meet with all of you then. 

Just in case you would like to know more about our work than this report 
can convey, our progress reports are located on reserve in the AJ.verno 
library under "Office of Evaluation." A complete documentation of the 
progress since fall, 1976 is recorded in four progress reports. These 
reports have been sent to Washington to the Office of the National Institute 
of Education (NIE) in the Department of Health, Education and Welfare. 

During the last year, we have received numerous comments from across the 
country about the importance of our mutual efforts. Besides yourselves, 
there are numbers of others who are awaiting the results. All of our 
research reports will be filed in the library as they become available as 
a means of letting you know what is happening in addition to these letters 
of feedbr.ck. 

We cannot make this contribution to the study of professions, to the 
understanding of important professional capabilities, to the understanding 
of the growth and development that takes place in college and of its 
meaning for later life, without ApI I an ro of rhir -'mp' 

fact every moment of every working day. e h v ^o; 

will share in the benefits as women, pro ^sic , n 
have accepted the challenge of the colleg- expt^rience. 



August, 1979 
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AlvernQ College 



September 4, 1979 



Dear (student's name): 



Welcome back to school! I hope you had an enjoyable summer. 

You may recall that you are scheduled to participate in the 
inventories to be administered by the Office of Evaluation on: 

Wednesday, September 12 
Kellogg Conference Center 
8:10 a.m. - 2:00 T>,m. 

There will be time for a break and lunch during the day. At the 
completion of the inventories. Dr. Marcia Mentkowski will be 
available to answer any questions you might have and to provide 
you with information on the progress of your mutual efforts in a 
specially arranged feedback session. 

As I mentioned in the previous letter, your instructors have been 
informed of your contribution, and have excused you from attending 
classes during the time noted above. l' 

Your participation in this important research is greatly appreciated, 

Sincerely, 

-I 

S. Christine Trimberger 
Chairperson 

Arts and Humanities Division 

CT:mh 
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AlvernQ College 

August' 3. 19 79 



I 



Dear Faculty Member, 

During Faculty Institute last May, Marcia "^"tkovski presented the latest 
results from the study. "Careering After College: Establishing he Valxdity of 
the college Experience for Later Success," funded by the National ^^^x ute of 
Education and currently entering its third >^ar. . If you are a new faculty member, 
^ the attached report being sent this summer tJ: student participants will be an 
introduction to this work being conducted by ^the Office of Evaluation. 

/ Thi. vear three important data collections will be made to continue our 

' evalia ion of the cu rfcu u^' To enable a more systematic data collection, we wish 

to irrange ^or the students who participate to contribute their time during the 
regular school day. Descriptions of the three data collections follow: 

- The first involves students who entered Weekend College in the Fall of 
m7 who will be reassessed on the inventories. They wil P-ticxpat,- ) 
during the orientation period for Weekend College m August. This 
collection will not affect your scheduling. ^ 

- The second data collection involves students "^o entered Wee^^^^^^ 't'T^Jr'' 
the Fall of 1977 who will a so be reassessed on ^!^e -vento les 

. o^i- a t^m^ fnr these students to participate this tail, tne lucill^ 

classes. 

We will notify you of the day and Lime. Again, you wiii □ 
absent from your classes. 

their continued contribution. 

Last yea.. «a.cia M-t.owsU and the omce of EvaluaUon^^^ 
■ successful in recruiting students that ^^^^ "^leve H 

procedures to -"-<''''--^/" :/\:/,rr '' L Office will be collecting about 
^jrin^ero^lerfrrzso'siyert's; ''Due to' this Increased volume, systematic | 
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other fonoi-uV studies ,re planned, b„t they will involve alumnae. 

Your support is needed to assist in this important work. I know wJ will all 
be looking forward to the results. ^ 



Cordially , 



The Discipline Chairpersons 



maq 

Enclosures (2) 



/ 
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A Alverno College 



October 18, 1979 



Dear (Student's name): 

As you may recall from my August 6 letter to you', a set of 
inventories was administered August 25 to the Weekend College women 
who entered Alverno in the fall of 1977 and also took the set of 
inventories at that tiTne. Since you were unable to attend this 
session, and because your participation in our efforts to evaluate 
the curriculum is so important, I am writing to ask if you will be 
able to schedule a time in the near future to come in to complete 
the inventories. 

Any date and time which is best for you can be scheduled. 
Completion of the inventories ranges from approximate!' three and a 
half to five hours, depending on the pace at which you work. The 
inventories (most of them are self-paced) can be taken all at once, 
or you can come in periodically for briefer time periods until you 
are finished. 

If you let me know on the attached form when you would be able 
to come in, Liz Davies will meet you in Room 408, Corona Hal l, at 
that time. 

As soon as all persons involved have completed the inventories, 
we will be able to prepare feedback to you on the Learning Style 
Inventory. Feedback will consist of a two-year comparison, showing 
your scores in 19 77 and 19 79. 

Tliank you vary much for your partictpation in this work, which 
is so important to the status of your degree, to the evaluation of 
the Alverno learning', process, and to the dcv(? Lopment of the 
(ccimmunic^a talons) curricul urn. 

Sincerely , 



Larry Clev(> , Coordi na tor 

P r o f s i o na 1 Conmni n ( c a 1 1 o ns De p a r r. wo n t 



LCriwli 

Attachment 
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APPENDIX R 



ALVERNO COLLEGE 
Milwaukee, Wisconsin 53215 



INTER OFFICE CORRESPONDENCE 



TO 



DATE Septeiuber 6, 19 79 



FROM M^ircia Mentkowski 



COPIES TO 



SUBJECT ADMINISTRATION OF INVENTORIES TO WDC 

STUDENTS WHO ENTERED ALVERNO IN FALL, 1.9 7 7 



During faculty institute, I reviewed the contents of the letter you 
received last month from the Discipline Chairpersons re5?arding the 
administration of inventories in September to the Weekday Colle^>e 
students who entered Alverno in Fall, 1977. You recall that the 
chairpersons have excused . these students from classes on September 12 
(September i'l for some nursing students) from 8:10 a.m. to 2:00 p.m. 
to allow them to be reassessed on inventories they also completed two 
years ago. 

Chairpersons have told students In a letter to them that faculty will 
be aware of their absence, will plan for it, and will not assi<:;n 
makeup work. (You also have a copy of this letter to students.) 

In order that you may plan for their absence, students who are excused 
from your class(es) are listed below. llnank you very much for your 
supper t . 

CLASS: DAY/DATE: 



STUDENT NAMES fJSTED HERE 



'^This listing may not he compl Lately accurate .since registrar's records 
wtnild not include students wlu) drop nr add classes between 9//t and 9/1 
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Alverno College 



APPENDIX S 



September 27, 1979 



Dear (Student's naine) 



Yesterday, I spoke with you about the ongoing work to evaluate and validate 
the curriculuiu, and to identify the capabilities of outstanding nursing 
performance. At that time, I asked for your continued parcicipacion in 
this effort and aijked that you let me know your response. 

Since yesterday, I have worked out an alternative option to participating 
that I think may be of help. I have arranged for Liz Davies to be available 
at your request for any time during the week, so that you could come in 
individually, when it is convenient for you, and work at your own pace. 
This arrangement would allow for working for short or long periods of time, 
depending on your schedule. 

Liz Davies' room number is //A08 Corona Hall and her phone extension is AAl. 
At the bottom of this page, there are some appointment times listed that 
she has already scheduled. In addition to these times, other times can 
be arranged to suit your schedule if these don't work out. 

I hope that this will be of some assistance to you and that it will enable 
you to participate. Again, thank you for your time yesterday. I believe 
it gave us the opportunity to discuss all the reasons for making this 
coimnitinent . 

Cordially , 




' I (jiAOJ 

Marcly Mentkoyskl 



These are some dates currently set up. Please check and return this slip 
to_rny mailbox. 

(Room A08, Co/ona Hall, is open from 8:00 a.n. to 5:00 p.m.) 



NAME: 



ERIC 



c 
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MONDAY : 

Oct. 1 Time: 

Oct. 8 Time: 

Oct. 15 Time: 

Oct. 22 Time: 

Oct. 29 Time: 



lliese times will uoi: work out for me, 
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FRIDAY: 

Oct. 5 Time: 

• I J Oct. 12 Time: 

[ J Oct. 19 Time: 

Oct. 26 Time: 
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APPENDIX T 



ComparivSon of WEC Women Who Entered in Fall, 1977, 
and Graduated in Spring, 1979 



Results 

Table A and Figures A and B show that, as a group, WEC students who 
entered in the Fall of 1977 with a previous college credits and graduated 
in Spring of 1979 did show a significant change in their preference for one 
learning style during the two-year period. Concrete experience is preferred 
significantly less in 1979 than in 1977. Even though the differences are 
not statistically significant, the mean Scores for active experimentation 
and reflective observation are slightly lower in 1979 than in 1977, and the 
mean for abstract conceptualization is slightly higher. Also, Figure B shows 
that there is a tendency to move from the Accommodator learning style to the 
Converger style, because of the shift along the Concrete/Abstract dimension. 
However, this shift does not reach statistical significance. 

Overall, the scores suggest that these WEC women may have established 
their preferences on the Reflective/Active dimension and maintained them with 
relative stability over their two years at Alverno. While the scores imply 
that a cnange in learning style ma^ be taking place among these women, the 
process is not rapid enough to be captured in two years. These women show 
a significant shift away from an earlier preference for concrete experience, 
and thus do shift on the Concrete/Abstract dimension. 

These results are tentative because of the small sample size (n = 20). 
.If we examine and compare these results to those from the larger study, we 
can conclude that college does promote a shift on the Concrete/Abstract 
dimension for these women as well. 
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TABLE A 




Group 


n 




CE 


i 


' AC 




iC-CE 


AE-RO 








1977 1979 


15JJ 

it/ 1 / 


1?]? 


157] 15J5 


19IJ 1979 


1977 1979 


1977 1979 


Entering WEEKEi 
^ Students in 
" Fall, 1517; 

Retested at 

Graduation 
Spring, 1979 


20 


Hean 
S.D. 


15.15+ lj.5lrr 
3,13 3.M 


12,30 
3.51 


ll.M 
3.11 


iO«DU i/iUJ 

2,98 3.H 


Ifi 15 lli.25 
IM 3.48 


1.45 3.55 
5.21 7.01 

f 


4.25 4.45 
4.92 iM 

1 



•f Row comparison significant: p < .05 
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LEARNING STYLE PROFILE 
Norms for the Learning Style Inventory 



Concrete 
Experience 



FALL 1977 
.SPRING 1979 




Reflective 
Obsefvation 



100% 



Abstract 
Conceptualization 



FIGURE A: LONGITUDINAL COMPARISON OF ENTERING WEEKEND STUDENTS (1977) WHO 
GRADUATED SPRING 1979. 
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LEARNING STYLE TYPE GRID 
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FIGURE B: LONGITUDINAL COMPARISON OF ENTERING WEEKEND STUDENTS (1977) WHO 
GRADUATED SPRING 1979. | 
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APPENDIX U Miiv;:vjr(- V ; ' 



Alvern9 College 

January 23, 1980 



Dear (Student's Name) 



You may recall my letter to ycu last August, inviting you to continue 
your participation in the evaluation project conducted by Dr. Marcia Mentkow^ki 
on the outcomes of the college experience. The third and final inventory 
collection from your group (students who entered in the fall of 1976) will 
again assess your capabilities in a number of areas related to future professional 
performance and will help to complete the picture of your college experience 
over the years. 

As we are well aware that many of you are nearing the end of your studies 
at Alvemo and will have more responsibilities this semester, we have set aside 
a block of time during a regular school day. The inventory collection will be 
held on: 



Thursday, March 13, 1980 

8:10 a.m. to 2:00 p.m. 

Room 074 in the Nursing Building 

F :ulty know that this date and time have been set aside and are planning 
their ^ourses to allow for your attendance at the inventory administration. 
However, I do ask that you inform each of your instructors that you will not 
be in class that day. It is important for them to know just how many students 
are excused from each of their classes. 

All of us in the Mathematical and Natural Sciences Division are very 
enthusiastic about the prcject and are giving our full support to this work. 
The insights we gain from this study will be invaluable in improving the 
curriculum at Alverno and in providing the best possible assistance to you 
in meeting your goals. 

We -ire investing time and resources in this project — and asking you to 
contribute your time and efforts — because we are interested in evaluating 
individual development. To know how your class fares at Alverno, we really 
need to look at how effective the program is for each student, from beginning 
to end. Aggregate data and group scores can obscure the unique individual, 
patterns and achievements that tell us what has really happened in the educa- 
tional process. Only longitudinal studies, looking at individual growth across 
time, can reveal these patterns. Tlie particular inventories used in this study 
look rather different from most or all of your course assessments , but they 
have been chosen as "outside" measures of general ability areas similar to 
the competences with which you arc familiar. They have also been shown in 
some cases to relate significantly to future professional performance — as 
we expect the Alverno curriculum to do. 
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Feedback on one of these inventories, the Learning Style Inventory 
(LSI), was mailed to you last spring by Dr. Mentkowski, who has also talked 
with you about the research objectives and the benefits of the study. You 
will be receiving further individual feedback on the LSI showing your changes 
in preference for learning style over four years of college. It will also 
include information on changes that you and other students show as a group 
throughout the college years. All the information is confidential. As 
you may remember, anonymity is maintained with code numbers used only by 
Dr. Mentkowski in her work with you. 

At the completion of the inventories. Dr. Mentkowski plans to meet with 
your group to answer any questions you might have and to present some of the 
more recent results from the studies of professionals that have emerged 
since her written report to you last summer. At that time, she will also 
be able to answer questions on an individual basis. She will let you know 
when you will receive the additional LSI feedback. 

You are an irreplaceable part of the longitudinal study. As a member 
of the original group that took the inventories at the beginning of your 
college experience in the fall of 1976 and again at midpoint in the fall of 
1978, you have already demonstrated a commitment to research that will benefit 
both you and other students as well. Your participation will increase the 
status of your Alverno degree, in that your future colleagues tend to have 
even more confidence in your capabilities as a professional when they are 
aware that ongoing studies are being conducted to continuously demonstrate 
the effectiveness of the educational process you have completed. I hope 
that you will again demonstrate that commitment by taking part in the inventory 
collection this spring. Your participation in this important work is invaluable 
and greatly appreciated. 

Sincerely , 

y/c..^ 

S. Alice Theine 
Chairperson 

AT:mh Mathematical and Natural Sciences Division 
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APPENDIX V 



ALVERNO COLLEGE 
OFFICE OF RESEARCH AND EVALUATION 



SOME QUESTIONS AND ANSWERS ABOUT EVALUATION STUDIES 



THIRD REPORT TO PARTICIPANTS IN A 
LONGITUDINAL STUDY OF COLLEGE OUTCOMES 



Marcia Mentkowski 



Funded by a grant from the National Institute of Education: 
Careering After College: Establishing the Validity of Abilities 
Learned in College for Later Success 
{NIE~G~77-0058) 

Principal Investigators: 

Marcia Mentkowski / 

Austin Doherty 

Alvemo College 

3401 South 39th Street 

Milwaukee, Wisconsin 53215 
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Alverno College 



Dear Participant, 

In materials dis tributed' a t feedback and dialogue sessions this past academic 
year, I described how I had gathered questions about the inventory collection 
from' students. I listed 11 such questions for youf review, and attached several 
pages of response titled "Some Questions and Answers About Evaluation Studies at. 
Alverno College." . . , ' 

I em now including an addendum to that letter on the following yellow pages, 
because I wish to respond to these additional questions that came up during the ^ 
s ess i ons . 

A. What has been done to insure that the inventory administration session 
fits my schedule and that I can find the time to contribute? 

B. Why are students who attend college part-time also participating? 

c! What effect does taking the inventories "too quickly" have on the results? 

D. Are there other arrangements for students unable to take the inventories 
at the time they are scheduled? 

E. May I speak with you personally? I still have some questions. 

Some of you may have further interest in the questions I listed last fall, so I 
have also attached my response to these previous questions (gold pages). 

1. What do the inventories measure? 

2. What are the benefits to me personally? 

3. What are the benefits to my major area, my chosen profession, 
to higher education, and to oth* r students? 

4. Why am I taking the inventories a third time? 

5. What feedback will I be receiving on the inventory results? 

6. What effect does it haye on the results if I remember some of" 
the questions on the inventories? 

7. Who has access to the inventories? 

8. Who has access to research reports on the group results from the inventories. 

9. Can i see my individual scores on the inventories? 

10. How does the concern, for "informed consent" by participants in the study 
relate to this kind of evaluation research? 

11. Who else is participating in the evaluation research besides me and other 
Alverno students? 

You will soon be receiving a progress report with the most current study results 
titled "Learning to Learn at Work: Students, Alumnae ^nd other Professionals." 

Your contribution this spring brrngs to fruition five years of longitudinal research 
on student performance on these inventories that will assist all of us to improve 
the curriculum for other women here and at other colleges. Thank you for your 
support. I trust I will be seeing you assessment weekend! 



Cordia.ly , 




T 

CKOWS 



Marcia MencKowski, Ph.D, 
Enclosures -^^^ Director of Evaluation 
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SOME QUESTIONS AND ANSWERS ABOUT EVALUATION STUDIES 
AT ALVERNO COLLEGE — Part II 

■jha t has been done to i-.sure that the Lnvcntory administration ses sion 
"ciTs my schedule and that I can find the~'time to contribute ? 



Aftor discussions with Weekend College students, faculty, the Weekend C-ollege 
coordinator and the Dean, we arranged to have the inventory collections schedulea 
during the external assessment weekend. May 1-3, 1981. This was communicated to 
students orally and in the materials distributed at the "Feedback and Dmloguo: 
What Have 1 Achieved" sessions conducted by Marcia Mentkowski and Dean Doherty in 
the Fall and Spring semesters. Students we spoke with felt that planning p.irtici- 
pation during a regularly scheduled assessment weekend ^^^^^^be better for most 
students thah asking students to ,:ome to campus outside regularly scheduled weekends. 

This week, each student's schedule for the external assessment weekend is being 
ca^refully reviewed. We will schedule each student's inventory collection period(s) 
around her assessment(s) . We have eliminated time conflicts with your a.ssessmentCs ) , 
and as nearly as possible, scheduled i nventory " col lec t ion periods to .y°J'l 
assessment(s). We have also schedule^ the inventory collection during periods which 
wilfbe least likely to cause fatigue. You will receive notification of your 
personal schedule for assessment weekend by April 2. , , 

Naturally, we do individual scheduling for the inventory collections at your 
convenience if you are ill, or have some other pressing problem that does not allow 
your part cipatLn during your scheduled time. We do. 'try to have all P^-ons • | 
complete the inventories at somewhat the same time to minimize the problem create? 
in any study when persons participate at different times. 

; Preliminary results from each inventory were carefully reviewed, to make sure ^ 
'that each should still be included in the inventory collection. In addition, one \ 
inventory the Alve rno College Career i ng Questionnaire , has been adddd. This 
nventory asks students to describe th liT^^^a ions for careering (starting cr 
hlng ng'iobs) after college. Since we have completed our first graduating senior 
^s. alumnae followup .tudy with Weekday College students, it ^.^^^^"^^ '^^L.end ' 
begin. to obtain information and evaluations of college preparation from our Weekend 
Sents also. Some of the preliminary results from our careering ^ i;^-^^^-'^^ - ^^^^^ 
included in the "Learning to Learn at Work: Students, Alumnae and Other Professionals 
progr(iss report you ar6 receiving. 

I ar-, very concerned, as are many people, with the issue of "over testing " - . 
Tests and testing have come under fire in recent y-^'^^-^-^P^^^i^y P"':^""^ '^^V,^,^ 
and intelligence tests. That is one of the important reasons the Naiona Institute 
of Education is funding this study. They are particularly interested in Alverno 
bLau^rof its approach to focusing on the broad outcomes of ^|;^^-^^^^,;/f^^^ ^^^^33 
and because of the way in which c^rse assessments are designed here Tbe inventories 
• sed in th. study are chosen precisely because they do not measure abilities the way-- 
commonly known tests do. We expect the abilif es and the way they -^^J^^;^ ° 
contribute to the way other testing is carried on including types of t.sts used in 
college, state boards, licensing, and personnel use in business Changes n,ust lA, 
n,ade tn the ways testing has been used to discriminate against different k.pds of 
persons . 

B. Why are students who attend eollege p art-time also participating ? 

' we have designed th!- eva luat ion study to assess students every ^-^^^f 
college The first inventory co 1 lec t ion was upon entering in Fall, 1977. The second 
coiieKe. y j^^^ y 3fter entering irf \ 

TpH r ^ ' Werkend'klle o! ersons stop in and out of college and may attend 

eitl,e?'nart- or full-time. So.ne of the persons who entered in Fall, 1977 have 
:.'<luatedr.om^ are graduating this semester, and so.ne will graduate in the future. 
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B. Why are studcntis who aLCend college part-time al;:;o participating ? (continuocl) 



All persons, whether toll- or part-time, are Lrreplaceab in the? cvaluati(Mi 
study. Ulien we analyze the Lnformat i.<m on student performance on the inventories,' 
we pay special attentioii to the amount of time a person has actually attended 
college during the four years. We call this factor "time in college." Obviously, 
^ we must consider "time in college" if we are to separate out the relative eff»^cts 
of college experience vs. other kinds of experiences, on the deve lopment of 
abilities measured by the inventories. Because our student group in Weekend ^'••/■^ t 

Collt^ge consists of both full- and part-time students, we can ask more questions ^ 
about the effect of the college experience than we would be able to ask without 
this comparison. 

C . What effect does taking the inventories "too quickly" have on the result s? 

While ''knowing the questions" does not seem to affect results on the,se 
inventories, rushing through them does. It is very important on these inventories 
that each person "stretch her thinking" to the utmost, in order for measurement of 
of her abilities in the fullest sense. That if why we schedule a period of time 
so that students can "take time" to really think through the questions and take a 
break if they feel fatigued. We are attempting to "break through" .artificial 
■ barriers and limits that have been set on women^s oerformance and abilities with 
these inventories. We know these limits are broken many times by Alverno women 
students — but like everything else, we have to demonstrate it! 

D. Ls there follow-up for students unable to take the inventories at the time 
t h ey are scheduled ? 

Yes. I make a special point to contact persons to provide alternative scheduling. 
Frankly, it is essential that we have a good follow-up so that the groups of students 
who participate can be assured that the results are truly representative of all 
Alverno students — not just those who may have a . particular time frame f re(^ . Group 
results ff^>om evaluation studies are meaningful when we can build on the complexity 
and richneW of representative data. If the results can be expected to generalize 
beyond Alverno to other colleges, and be helpful to other women, we must do a good 
job of arranging things so everyone can parcicipate. Educators who are considering 
changes are unimpressed when evaluation studies are conducted only with a few students. 

This year, we have our first opportunity to inventory the abilities of experienced, 
adult students who have been "in college" for four years. Little, if any,- longitudinal 
data on experienced adults exists in higher education that can be used to develop 
curricula for* adult learners. 

We have had excellent cooperation from students. People outside the institution 
' often comment on the professionalism of Alverno students — who, by participating in 
evaluation research, make such a large contribution to other women, to their pro- 
fession and to higher education. 

E . May I speak with you personally ? I still have some questions . 

I will be delighted to discuss any issues with you individually. My 
office number is 647-3811. I will also be able to discuss issues with you 
following your participation in the inventories so that you can ask questions 
about a particular inventory— or comment on its use as a tool. At that time 
I will also discuss some of the result.s detailed in the latest progress report. 
^-^9^"R-^^^"it)er , my home phone is 774-^7018. 307 
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SOni;: QUESTTONS AND ANSWERS ABOUT 'ZVAEUATION STUDIES 
AT Af.VERNO COLLEGE 



1 . l-^al do t:he inventories me^lsure ? 

The inventories measure broad abilities that are expected outcomes of 
CO Liege, They measure abilitier; such as analysis, problem-solving, conceptual 
thinking related to social interaction, the valuing ability, etc. But they 
also measure more intangible abilities that are also expected to predict 
professional and career performance,. 

One example of a more intangible ability is learning style, measured by 
the Learning Style Inventory. Learning style is an important ability for 
starting or changing jobs and learning on the job. 

The Picture Story Exercise is another example. Wlio could forget the six 
pictures and the six stories you are asked to write? Abbey Stewart, who 
designed tiiis instrument, has been working for years to uncover the motiva- 
tional patterns of women who are particularly successful personally and 
professionally. Early data indicates that Alverno women, even when they first 
enter Alverno, have particularly well-developed motivational patterns. How 
do these patterns — so critical to "moving" in a career or profession — develop 
further during college? For whatever goals women want to achieve in life — . 
be they personal or professional — motivation is the key to any kind of success. 
Results from this inventory will lead to further understanding, so women can 
develop their own motivational patterns even more. 

Another irleasure that students sometimes ask about is the Se ntence Completion 
inventory, which requires completing unfinished sentence stems. Sometimes the 
sentence stems seem unrelated to college learning. Yet the purpose of the 
inventory is to measure women's perspectives across age, and across the life- 
span so that we can get a better understanding of thinking as it develops in 
college. The sentence stems are asking persons to respond to experiences 
which everyone might be expected to have — irrespective of a person's socio- 
economic, geographic, religious, racial or cultural background. If the 
sentence stems were too related to the college experience, they would dis- 
criminate against respondents who had not had certain educational opportunities, 
or are not college students. Responses to sentence stems are analyzed for 
thinking ability, not personality. 

All the inventories fit together to form a composite picture of both the 
tangible and more intangible outcomes of the college experience. They are 
not personality tests. They measure performance and cognitive abilities and 
perspectives — how people think. 



2. Wliat are the benefits to me personally ? 

Personal benefits come to you in the form of individual feedback on the 
Learning Style Inventory, and feedback and dialogue sessions, and progress 
reports that keep you up to date on the results. These results give you more 
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Information to talk about the outcomes of college for Alverno students. A senior 
who iaterviewed me recently asked; '^Alverno is different in some ways than 
other college^. How can I talk about my college experience in a way tliat will 
communicate to others, in a meaningful way, that going to this kind of college 
was 'worth it/' I personally feel very strongly that the Alverno program will 
benefit me to a greater extent than some other colleges I might have chosen. 
But how can I 'stand up for my choice' for selecting this kind of college?" I 
expect these evaluation research results to provide graduates of Alverno with 
information to enable them to talk to others— including potential employers— 
about the demonstrated outcomes of the Alverno curriculum. The 1980 follow-up 
study of alumnae who graduated in Spring, 1978, also provides valuable data on the 
careering of graduates . Since a major reason students choose Alverno is to 
develop careering skills and professional abilities for employment purposes, 
the careering success ol Alverno graduates is of particular importance to the 
Alverno s Ludent . 

3 . Wliat are the benefits to my major area, my chosen profession, to 
higher education, and to other students ? 

The major personal benefit to an Alverno student participating in the 
inventory collections comes to her as a member of a professional group such 
as professional teachers, nurses, managers, writers, musicians, artists, 
historians, etc. Other groups that benefit, of course, are alumnae, college 
students, employers who hire college graduates , faculty who teach ir higher 
education, etc. Institutions also benefit — colleges, hospitals, schools, 
business firms, volunteer agencies, etc., as a result. 

Let me elaborate on some of these benefits more specifically. 

College students, including Alverno students, benefit because evaluation 
results enable a systematic critique of curriculum, so that faculty can be 
more effective in giving students the skills and abilities they need. Higher 
education must better understand how adults learn and what abilities are 
really important if it is to survive the 80s' downward enrollment trends. 
Employers in business have long challenged liberal arts colleges for being 
unable to graduate students with effective communications and other skills 
so that a firm has to spend money not just on expected job training, but on 
"re-training" persons who should have certain skills and abilities. Many 
employers are looking for women to hire to fulfill affirmative action 
programs— but women must be competent. Institutions , such as hospitals and 
schools, are interested in graduates being educated for the future , not just 
the present. All these groups are interested in the outcomes of college 
and whether they predict future effective performance. 

Professionals are interested in colleges demonstrating that they are 
effective in graduating students who are competent so that the degree is a 
meaningful credential. Other specific benefits accrue to professional groups. 
Licensing and state boards or exams are undergoing severe criticism in many 
professions, nursing in particular. The critique is that 3tate board exams 
do not predict future professional performance. Groups are working to change 
the content of the state boards, but they are asking: "l^/hat should we 
measure? What abilities do predict effective performance in nursing? The 
inventories you are completing are designed to measure these kinds of 
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abilities — and Lo sliow they ca n be measured in ways other than the currently 
designed state boards. 

And there are benefits to women. Some employers think some abilities can only 
be developed to the fullest extent by men. We expect this study to break these 
limits and barriers by demonstrating that women not only have the abilities, 
but that they can achieve the professional goals they set for themselves. 

4 . Wliy am I taking the inventories the third time ? 

Our earlier results showed us that we had to collect longitudinal data 
(give the same inventory at the beginning, midpoint, and toward the end of the 
student's college career). Seniors in 1978 also took the inventories, and we 
have cross-sectional data. But then we discovered that we could not be sure 
that either entering or graduating classes were necessarily alike. For 
example, on some inventories, entering classes in 1976 performed differently 
than entering classes in 1977! Longitudinal measurement — across time — is the 
only way to insure that the results are valid! This is especially important 
because the curriculum changes as well. Further, there is little, if atiy, 
information on the learning and abilities of the graduates who enter programs 
created for more experienced adults (e.g. Weekend College^. 

I am very concerned, as are many people, with the issue of *' over testing .^* 
Tests and testing have come under fire in recent years — especially personality 
and intelligence tests. That is one of the important reasons the National 
Institute of Education is funding this study. They are particularly interested 
in Alverno because of its approach to focusing on the broad outcomes of the 
college experience, and because of the way in which course assessments are 
designed here. The inventories usee' in the study are chosen precisely 
because they do not measure abilities the way commonly known tests do. We 
expect the abilities and the way they are measured to contribute to the way 
other testing is carried on including types of tests used in college, state 
boards, licensing, and personnel use in business. Changes must be made in 
the ways testing has been used to discriminate against different kinds of 
persons . 

Longitudinal group results from evaluation studies are meaningful when we can 
build on the complexity and richness of representative data. If the results can 
be expected to generalize beyond Alverno to other colleges, and be helpful 
to other women, we must do a good job of arranging things so everyone can 
participate. Educators who are considering changes are unimpressed when evalua- 
tion studies are conducted only with a few students. 

We have had excellent cooperation from students. People outside the 
institution often comment on the professionalism of Alverno students — who, by 
participating in evaluation research, make such a large contribution to other 
women, to their profess ion and to higher education. 

5 • What f e edback will I be rece ivin g on the i nventory results ? 

Your individual score and group data on the Learning Style Inventory will 
be mailed to you soon after everyone has completed the inventories. Yoj will 
be receiving other progress reports, even though you may have graduated. 
These reports similar to the two you have already received, include results 
from the^other studies of professionals and the student and alumnae interviev/s. 
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6 . Wliat effect does it have on the results if I rem ember some of the ques tions 
on the inventories? 



T know that since you are taking the inventories for the third time you 
will remember some of the questions. The inventories' as nearly as 1 can 
determine at this time, have good test-retest reliab . .try. But because they 
are relatively new, alternate forms are not available. Frankly, having s - a 
question before is not expected to affect the results, since we are not asking 
questions where there is a "right answer." Even knowing what is expected 
should not effect the results, because the inventories measure your ability 
as you have developed it up to this time. That is what is important. The 
inventories do not consist of "trick" questions or questions which require a 
"right anewer," which if you knew, would affect the results. For the most 
part, it is obvious — even to the student entering college, what the question 
is measuring. 

7 . I'/h o has access to the inventories ? 

Only the Office of Evaluation professional staff members who do some 
coding of the inventories have access. Other inventories are sent to expert 
coders in Boston. No piece of inventory data is ever entered in the student's 
college file. Neither faculty nor adr.:i nis Lrators have access to any indi- 
vidual student's inventory score. 

I7e use code numbers to protect persons and to insure confidentiality and 
anonymity . The most important ethical issue in inventory collection or 
interviews is protecting the participant's right to contribute confidentially 
and anonymously * Code numbers also allow me to compare performance from one year 
to the next — and to give you pers'^ral feedback on the Learning Style Inventory. 

8 . Who has access to research reports on the Rroup results from the 
inventories ? 

Students, faculty, administration, the business and professional community, 
the National Institute of Education who supports the study and other persons in 
higher education. Two major papers were presented in Boston in April, 1980 to 
the American Educational Research Association. Results from the Learning Style 
Inventory have been mailed to student participants, and special progress reports 
describing general results were mailed to student participants. Extensive 
progress and research reports are on reserve under "Office of Evaluation" in the 
library. Many visiting faculty from other colleges also have access. 

9 . Can I see my individual scores on the inventories ? 

I would never deny the right to see one's own scores to any student. But 
there are two ethical considerations I must keep in mind in giving you your 
individual score. First, a single score must be meaningful. Second, an 
individual score must be given in a context, it must be accompanied by feed- 
back on "what my score means to me." 

The Learning Style Inventory is an instrument that is meaningful because 
the inventory was originally designed to provide individual scores together 
with feedback. Second, it can be scored quickly enough sc that feedback can 
be given relatively quickly compared to other inventories which may take 
months to code. Even so, I have added to the feedback information designed 
for the LSI by creating a page of "qualifications"— how not to interpret your 
score. Too often, we all seem to take any kind of test score too seriously 
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The other inventories were not designed to give out individual scores, and 
have no such accompanying feedback. They have been developed to provide £rou£ • 
results for large numbers of persons— to see trends and differences in per- | 
formance in broad abilities over time. Therefore, an individual score is not 
necessarily meaningful— it is the group results that create meaning. 

Since it is the group results that create meaning rather than the individual 
scores, I present feedback to students in the form of progress reports 
describing the r its, except of course, for the Learning Style Inventory. 

10. How does the concern for "informed consent" by participants in the study 
relate to this kind of evaluation research ? ^. 

I have been particularly concerned that you have as much information as 
you feel you need about the rationale and purposes of evaluation studies. I 
feel this is especially important because in a study of nhis sort— which takes 
four years to complete— explanations of rationale and procedure I have enumerated 
on a number of occasions are easily buried under mounds of other information. 
Who would remember Dean Doherty's speech or my comments to you on your first 
orientation days in Fall, 1977, before you first completed the inventories? Or 
the talk to vou in 1978? Or the talks to you either individually or in a group 
prior to or after the 1979 inventory collections? Or all the information in the 
two Learning Style Inventory feedback packets? Or the material in the two 
pro^£.ross reports? Or the contents of the letters from chairpersons re- introducing 
vou to the study? How many students really have been able to read the elaborate 
pro^^ross and research reports on reserve in the library under "Office of Evaluation r 
Now that I have more experience, I can see even more alternatives for communicating 
to you than I was aware of when I first began my work here. I have also learned a 
much more about what students really want to know. The question/response format ^ 
of this lettor is. 1 hope, a more effective method than a speech. 

Tills kind of evaluation research is seen as part of the college experience, 
and the Inventories are similar to other college assessments in that they are 
an expected part of college for students. The difference between these 
inventories and regular course assessments is that they are us'-^d to demonstrate 
changes in group perf or:nancc over time for all students — and can cross content, 
1 discipline and career lines. Inventories such as these are given to improve 
(instruction and demonstrate the validity of the college experience. Educators 
evaluation research as part of the original "contract" made between 
inslri'tution and student, and so expect students to take the inventories in 
the same way that they take assessment instruments. \-/hat is different about 
the inventories is that they are not used to credential. The scores of an 
individual student are not ever shown to an instructor or administrator. 
We deliberarely do nt^t make the inventories, c^r other evaluation toc>ls like 
the attitude survey, a criterion for graduation. That would defeat the purpose, 
because we. are interested in measuring performance of^ abilities in the absence 
of pres.sure for credentialing or validation. 

In sum, the ethical issues in conducting evaluation studies include pro- 
viding information about the pjOq^oses of the study and what the inventories 
measure, establishing ways to [insure confidentiality and anonymity, and 
providing the group results to participants. 

This type o£ evaluation research is, of course, quite different from ^ 
experimental research, where different groups are being "experimented on," 
that is, given different treatments. In our evaluation research, for example, 
everyone takes the same inventory — and we are not "manipulating variables" or 
experimental conditions. If we did that kind of research we would be asking 
for volunteers, and we would be asking persons to fill out "informed consent*' 
forms. ^312 
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li. Who else is participating in the evaluation research besides me and other 
Alverno students ? 

Over 80 registered nurses and 103 women managers and executives in the 
Milwaukee area are contributing to the professional studies. They contribute 
interviews and take other instruments as well. We have been extremely gratified 
at the excellent participation from these professionals too. They are also 
eagerly awaiting results and are, in some cases, planning to put them to use 
in their institution! You may recall that the study also is identifying competence 
models of three professions by going to the professionals themselves— to identify 
what abilities are critical for outstanding performance in their chosen field. 

Alumnae from the Class of 1978 also participated in 1980. A careering 
"questionnaire was sent to all alumnae. Half of these former students came 
to Alverno for nn individual 2-hour interview in summer, 1980. 

Groups of students in both Weekday and Weekend College are participating. 
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Alvern9 College March 4, i98o 



Dear (student's name): 

You may recall my letter to you early in the semester, 
inviting you to continue your participation in the 
evaluation project on the' outcomes of the college 
experience. In my letter, I also Informed you of the 
date set aside during a regular school day. I would 
like to confirm the date and time: 



Faculty know that this date and time have been set 
aside to enable you to contribute, and have planned 
their courses to allow for your absence from classes. 
There will be time for a break and lunch during the day. 
Dr. Hentkowski will be available after you complete the 
inventories to answer questions and give you additional 
inforuiation on the study results. 

Dr. Mentkowski has written you a special letter in a 
question and answer format that she wrote after meeting 
with some of the students who will be taking the inven- 
tories March 13. This letter to you is attached. 

You are an irreplaceable part of this longitudinal 
study. I hope that you will again demonstrate that 
commitment by taking part in the inventory collection 
March 13. Your participation in this important work 
is invaluable and greatly appreciated. 

Sincerely, 



Thursday, March 13, 1980 

8:10 a.m. to 2:00 p.m. 

Room 074 Nursing Building (downstairs) 




Sister Alice Theine, Chairperson 
Mathematical and Natural Sciences Division 



Enclosure 
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APPENDIX X 3401 S 39tti Street 
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(414)^)/! S40O 



A 



Aivern9 College 



Fall, 1980 



Dear (Student's name): 



I am writing to commend you on your contribution to the inportant work 
being conducted by Dr. llarcia Mentkowski on the outcomes of college. This is 
indeed an exciting project," and as a contributor you have already demonstrated 
a cocunitment to research that will benefit not only you, but other students 
as well. I also wish to conmunicate that all of us in the Behavioral Sciences 
Division are very enthusiastic about this project and are giving our full support 
to this effort. Tlie insights we gain about the learning and abilities of students 
are invaluable in improving the curriculum and in providing the best possible 
assistancH to you in meeting your goals. 

^An example of the most recent impact of your contribution is the group 
results from the Learning Style Inventory. These were railed to you following 
your two previous participations, and presented to the faculty in May. At 
that time, David Kolb, professor at Case Western Reserve University, author of 
the Learning Style Inventory and originator of experiential learning theory, 
met with the faculty to" discuss his recent insights on how students and career 
professionals learn. Together "with Dr. Mentl.owski , he discussed Alverno student 
preference patterns on the Learning Style Inventory and drew implications for 
college curricula. Dr. Kolb also met with facilty who are working to increase 
the ways in which learning can occur in the variety of off-campus experiential 
learning settings students experience. Thus, the results from just this one 
inventory are serving as important guideline^ for faculty to improve learning 
experiences. Tlie results also validated that students as a group leap dramat- 
ically in their preference for abstract conceptualizing after two ye.ars in 
college, an important step if learning in settings off campus is to occur in 
the best possible ways. o 

I am also writing to ask for your continued assistance during the Spring 
Semester in 1981. Since this work is an institution-wide effort, the chair- 
persons and faculty have set aside time for the inventory collection. We are 
well aware that many of you will have increased responsibilities as you near 
the end of your Alverno studies, and we have arranged for your participation 
this spring in a way that will enable you to contribute as part of the regular 
school day. 'I an writing to you now so that you will have adequate time to 
plan this work and schedule it with your other responsibilities. I will 
notify you shortly after the second semester begins in January 1931 as to 
just when you will be involved. (If you are graduating in December, we will 
involve you then.) 
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I know that you have had a number of opportunities to hear Dr. Mentkowski 
discuss the study purposes and outcomes since 197 7 and have received three 
written reports. Still, I would like to add a noLe to her comments, to 
underscore the importance of your contribution. 

You are an irreplaceable part of a longitudinal evaluation study. We are 
investing time and resources in this project—and asking you to contribute your 
time and efforts — because we are interested in evaluating changes in learning. 
To know how your class fares at Alverno, we really need to look at how effec- 
tive the program is in promoting learning, from beginning to end. Aggregate 
data and group scores alone can obscure the unique growth patterns and 
achievements that tell us what has really happened in the educational process* 
Only longitudinal evaluation studies, looking at changes in learning across 
time, can reveal these pa.'-tems. 

The particular inventories used in this study look rather different from 
most or all of your course assessments, but they have been chosen as "outside" 
measures of general ability areas similar to the competences with which you 
are familiar. Many have also been shown to relate significantly to future 
professional performance — as we expect the Alverno curriculum to do, 

rne benefits from this study will multiply over tlie years. You will 
receive individual feedback on the Learning Style Inventory once again, and 
other group results. But your participation will also increase the status 
of your degree, in that your future colleagues tend to have even more confi- 
dence in your abilities as a professional when they are aware that ongoing 
studies are being conducted to continuously demonstrate the effectiveness of ' 
the educational process you have completed. In taking this opportunity to 
"again demonstrate your professionalism by contributing to such an effort, 
you join 84 nurses and 115 women managers and executives in t,he Milwaukee 
area who have also contributed a picture of their abilities. Your work 
complements and extends similar participation by other; weekday and weekend 
students, and the alumnae of the class of 1978, many of whom interviewed on 
campus this summer to create a picture of the abilities needed for "life 
after college," Dr. Mentkowski plans to share the alumnae report with you 
this year. 

Your contribution toward describing abilities learned in college can 
make a difference — to you, to other women in higher education, and to the 
professionals you will join as colleagues. I thank. you for your continued 
assistance . 

Sincerely, 




AW:dvp 



Allen Wutzdorff, Chairperson 
Behavioral Sciences Division 
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^ Alvem9 College 

3401 South 39th street / MNwauNmi. Wl 



MEMO 

TO: 



Alverno Faculty: 

Date for Weekday College Inventory Collection 



FROM: 



Discipline Division CViairpersons 



DATE: 
RE: 



December 



1980 



Inventory Collection for Weekday 
1977: March 24, 1981 for Weekday College 



and Weekend Students Entering Alverno in Fall, 



In order to assist you .in planning classes and syllabi for next semester, w^^^^^ 

would like to notify you of plans for some students on March 24, 1981. 

The attached letter details the plans of the Office of Kvaluation to administer 
inventoriis to all students who entered Alverno in 1977 in Spring, 981. Mo.st 
of these students, but not all, are graduating in May of 1981. Full-time and 
part-time students are included in this group. The date chosen for this data 
collection is Tuesday, March 24, 1981. To enable a systematic data collection, 
the 100 students who are involved will be excused from classes on that day 1 rem 
8-00 a m until 2:00 p.m. As mentioned in the attached letter to you, the 
students will be told tfiat you are aware of their absence, that you will 
allow for it, and plan March 24 with their absence in mind. We will ask 
each student to notify you if they will be one of the absent students. 

The students in this particular group are taking the inventories for the third 
time- they completed these inventories during new student orientation in 19//, 
in Fall, 1979, and will complete them again in March, 1981, prior to graduation, 
This last data collection on the inventories is vitally important. It will 
enable a complete set of longitudinal data on the inventories and will be a 
major contribution to the evaluation of the curriculum. We will continue our 
contact with these students after college to allow for foUowup studies. 



As March 24 nears, a reminder memo will be sent to you, 
important work.is needed and greatly appreciated. 



Your support in this 



cc: 



Istudents will be notified of this date after they return from the Christmas 
vacation. 
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1980 



Im.'U' Faculty Munibi'i', 

IHiring Faculty Institute last May, Marc i. a Montkowski Ln a spc'cial session 
iv'iLh David Kolb, prt»scntt.'d the latest results iron] tlie study, "(\ireerin^ After 
C(.)llege: l^stabl i sli ing the Validity of Abilities Learned in Colle^'.f for Later 
Succ*.'ss," funded by the National Institute of }-:ducation and currently completing 
its third year. If you are a new faculty nieinbc^r, you had 'm\ introduction to 
this work being conducted by the Office of valuation durin/ Fall ori(MUation, 
and received several related materials at that' time, including a l)rii'f synopsis 
o f t l u? p r o J e c t s e n t t o s t u d e n t s . . . "T ". 

I'his year, two important data collections will be made to continue our 
evaluation of th*.* curriculum. To enable a more sy s t ema t ic data collection, 
we wish to arrange, for the students who participate to contribute their time 
during the regular school day, just. as we did last year. Descriptions of the 
two da t a col lec L ions fo 1 lov; : 

1. The first data collection involves students who enti'red Weekday ColFige 
in the Fall of 1977 who will be*assessed for tlie tin rc! time on the 
inventories. In ord(U' to set a t iiiu^ for tliesr students to j^articipate 
in Spr ingV"T98"]", the c ha ir persons will excuse them 1 rem c 1 a,-; se s 

March 24. Students wlio are i nvol ved • ( mos t are seniors) will be excused 
from classes from 8:00 a.m.J:o 2:00 p.m. on tliat day. You will be 
notified by letter prior to March 24 exactly win) will be absent from 
your c l.asses . 

2. The second involves students who entered Weeki'nd College in the Fall of 
1977 who vill be assessed for the third time on tlu? inventorizes. Tiiey 
will participate daring assessment weekend for Weekend College, May I - 3, 
1981. This collection is being worked out witli Weekend College 
Coordinators . 

I am enclosing a copy of our letter to Weekday College students and tlie 
"(juestion and answ(!*r" letter fromMarcia attached to the fall letter 
reintroducing the st\idents to the project. I have promised stuchnts that 
you will be aware of their absence, that you will allow for it, and plan 
class on March 24 to allow for th(?ir attendance^ at the inv(^ntory ailm i n i s tr a f i on . 
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l.,ast. voar, Marcia M<,'ntkowski ami tlu' Offici' of 1- va luat i f.Mi staff wci'i' *;o 
sue cl^s s f u i in r^'Cr u i t in^', studontr; ancl alumnat^ that: tlioy at.-h i c^vt'd ov^r 
pa I' t ic i pa t i on . The {U'ocodii rt\s , ti) ai."hii'Vr this rt^snlt ar<' ha^yod on a yn)lirv 
of providing as ruicii information as possibK^ to s t ud on t s ab(urt tlio raMonviN.^ 
and results of participation. For oxarnpK^, tlils fall, Austin OoluTtv and 
Marr i.a In^id a s»'riis of five fofdf.iack /ind d!ali)i;in' st.\^sions on. t ho [)ro'p'i.-( 
vntli Weokt^nd ToIU'i-o stndonts. Marcia is currontly pianninj spr^ ial itotinrs 
wi.th students involvtHl in \'/ookday Collop.o. Sucli o{ forts, togt-tlior wit!! vom 
inltArmod su{)p()rt, aro tho koy to tho aiiioinit and cjiiality of stndrnt [)ai( icipat i« 
I n\M -nt or i i*s for studonts in tlu' Spring of M)81 is tho fin.il colKH-tion o\' tur 
projoct involving: stndonts. Othfr follov;-ii[) stuciios art* plannori, hut thoy 
v;ill invc^lvo aluinnae. 



HI 



Your support is ncodod to as.sist in this inipcutant worf: 
all h'.- lov»kiir.:^ t'or'wa rd to the ri* suits. 



] k now ( ! 1 a t , wo w i 1 1 



Cord i a 1 1 >' , 



Tho nisoii)lino Cdui i rpor .^ons 



Lot tor to U'DC stndonts 
Marcia's ii'ttor to stiidonts 
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Alverno College 

^ February 2, 1981 



1 

Dear (Student's name): 



You may recall my letter to^ycu last August, inviting you to continue 
your participation in the evaluation project conducted by Dr. Marcia Mentkowski 
on the outcomes of the colle2;e"^ex^erience , The third and final inventory 
collection from your group (st'.idents who entered in the fall of 1977) wil^ 
again assess your capabilities in number of areas related to future professional 
performance and will help to complete the picture of your college experience 
over the years. 

As we are well aware that many of you are nearing the end of your studies 
at Alverno and will have more responsibilities this semester, we have sat aside 
a block of time during a regular school day. The inventory collection will be 
held on: 

Tuesday, March 24, 1981 

8:10 a.m, to 2:00 p.m. 

Room 0 74 in the Nursing Building 

Faculty know that this date and time have been set a^ide and are planning 
their courses to allow for your attendance at the inventory administration. 
However, I do ask that you inform each of your instructors that you will not 
be in class that day. It is important for them to know just hov; many students 
are excused from each of their classes. 

All of us in the Behavioral Sciences Division are very enthusiastic 
about the project and are giving our full support to this v/ork. The insights 
we gain from tliis stud^ will be invaluable- in improving the curriculum at 
Alverno and in providing tlie best possible assistance to you in meeting your 
goals. 

We are investing time and resources in this project — and asking you to 
contribute your time and efforts because we are interested in evaluating 
individual development. To know how your 'class fares at Alverno, we really 
need to look at how effective the prof^,rain is for e^ch student, from beginning 
to end. ..Aggregate data and group scores can obscure the unique individual 
patterns and achievements that tell us what has reially happened in the educa- 
tional process . Only longitudinal studies, looking at individual growth across 
time, can reveal these patterns. The particular inventories used in this study 
look rather different from most or all of your course assessments, but they 
have been chosen as ''otitside'' measures of general ability areas similar to 
the competences with which you are familiar. Many have been shown to relate 
significantly to future professional performance — as we expect the Alverno 
curriculum to do. 
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Feedback on one of these inventories, rhe Learning Style Inventory (LSI),* 
was mai'ed to you last spring by Dr. Mentkov ki, who has also communicated 
with you aoout the research objectives and tne benefits of the study. You 
will be receiving further individual feedback on the LSI showing your changes 
in preference for learning style over four years of college. It will also 
include information on changes that you and other students show as a group 
throughout the college years. All the information is confidential. As 
you may remember, anonymity is maintained with code numbers used only by 
Dr. Mentkowski in her work with you. 

At the completion of the inventories. Dr. Mentkowski plans to meet with 
your group to answer any questions you might have and to present some of the 
more recent results from the studies of professionals that have emerged 
since her written report to you last summer. At that time, she will also 
be able to answer questions on an individual basis . She will let you know 
when you will receive the additional LSI feedback. 

You are an irreplaceable part of the longitudinal study. As a member 
of the original group that took the inventories at the beginning of your 
college experience in the fall of 1977 and again at midpoint in the fall of 
l<)79, you have already demonstrated a commitment to research that will benefit 
both you and other students as well. Your participation will increase the 
status of your Alvemo degree. In that your future colleagues tend to have 
even more cor.Udence in your capabilities as a professional when they ar : 
aware that ongoing studies are being conducted to continuously demonst) dte 
the effectiveness of the educational process you have completed. I hope 
that you will again demonstrate that commitment by taking part in the inventory 
collection this spring. Your participation in tliis important work is invaluable 
and greatly appreciated. 



Sincerely , 




S . R o s e mil r y H u f k e r 
(>hai rperson 
Hducat i on D ivi si on 
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Alvern9 College 



3401 South 39th SIrMt / 
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MEMO 

TO: 



FROM: 

DATE: 
RE: 



Marcia Mentkowski 
Office of Evaluation 

February 27, 1981 

ADMINISTRiVTION OF INVENTORIES TO WDC STUDENTS WHO ENTERED ALVERNO IN FALL, 1977 



As you may recall, a memo was sent to you last December from the Discipline 
Division Chairpersons informing you that inventories will be administered 
on Tuesday, March 24 to the Weekday College students who entered Alverno in 
Fall, 1977 . T\\e chairper$ons have excused these students fiom classes from 
8:10 a .IT), to 2:00 p.m . thiit day. The students in this particular group are 
taking the inventories fo|: the third time. They completed tliese inventories 
during new student orientation in 1977 , and again in Fall, 1979. Tliis will 
complete th'^ set of longitudinal data on the inventories and will be a major 
contribution to the evaluc^tion of the curriculum. 

Chairpersons told students\in a January letter (attached) that faculty will 
be aware of their absence and will allow for their attendance at the 
inventory administration in\ their planning. A reminder letter to the 
students, which includes answers to questions, frequently asked about the 
study, will also be forwarded to you. 

In order that you may further plan for their absence, students who are 
excused from your class(es) are listed below. ''^ lhank you very much for 
your ,s up port . 



CLASS : 



Kiu'losure: I, filer from Disci pi imv Division Cha i rprr son 
t tt'r ( roin M;irc i a Mci) I kowsk i 
TwM sels ot "Que^^ I ; uu.s and Answers about Kvalnation Studies 

at Alvcruo" (note e,sprc.*ially tiie 'M)lue" j>:i^;es ) 
A VroyVi'-Mi Kt'j)()rt t() Tar t i c i pant s 

'III i s listin^^, may not Ijt (. oinp U I c 1 y accurate sinrc Kc^^, i s l lar ' !; records 
would Tiot. inc'iude slinit'uls who (irop[jeil or atidrd classes alter Fchriiary 13. 
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ALVERNO COLLEGE 
OFFICE OF RESEARCH AND EVALUATION 



LEARNING TO LEARN AT WORK: 
STUDENTS, ALUMNAE AND OTHER PROFESSIONALS 



FOURTH REPORT TO PARTICIPANTS IN A 
LONGITUDINAL STUDY OF COLLEGE OUTCOMES 



Marcia Mentkowski 
Deborah Fowler 



Funded by a grant from the National Institute of Education: 
Careering After College: Establishing the Validity of Abilities 
Learned in College for Later Success 
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LEARNING TO LEARN AT WORK: 
STUDENTS, ALUMNAE AND OTHER PROFESSIONALS 



A PROGRESS REPORT TO PARTICIPANTS'^ 



2 

Marcia Mentkowski and Deborah Fowler 



Some students come to college directly from high school. Others attend 
after an interim filled with extensive work and personal experience. All are 
interested in how college learning will prepare them for "life after college." 

In earlier talks and written repurts, we have discussed how students' 
preferences for "thinking" ~ for abstract conceptualizing, for reflecting 
and planning action — developed during college. But at some point each 
student looks beyond college. She sees herself beginning an entry-level 
position, taking on assignments with more complex responsibilities, realizing 
greater self-enhancement and meaning in her personal life. How will college 
learning make a difference then? In what ways will she really be prepared? 

In this report, we respond to these questions by reviewing some initial 

\ 

findings from our analysis of student performance on inventories and 
interviews completed during college as part of curriculum evaluation efforts. 
We will also share some of the initial findings from last summer's interviews 
of the 1978 gradufites who participated in the study as seniors, and again as 



' Part icipaiU s include students entering Alveruo in 1976 and 19// who 
contributed throughout college, 1978 graduates who contributed as senh^rs 
and as alumnae in 1 980, and pro f ess it)na 1 nurses and women managei-; In the 
Milwaukee area. 

"^Mark lltMu provided editorial ass i.sLan(^e . 
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alumnae two years later. Finally, we will review our studies of other 
professionals, part of which are now complete. From the results we have 
so far, we will respond to the following questions: 



• How do students "learn to learn*' at work? What abilities 
do they utilize in new situations they face in Off Campus 
Experiential Learning (OCELs) , clinical experiences or 
current jobs? 

• How do alumnae learn to learn at work? Wl^at abilities do 
they use in new situations? 

• How do other professionals learn to learn at work? What 
abilities do they use in new situations? 

' Does a college degree make a difference in the kinds of 
abilities demonstrated by outstanding professionals? 

• What are tlie implications for higher education? 

WHAT WAVE I LEARNED IN COLLEGE? 

Earlier we noted that results from the inventories indicate that 
Alverno*s graduating seniors show more complex and sopliist icated thinking 
abilities than students just entering college from high school. Seniors 
also perform at a higher level than entering students who have extensive 
out-of-college life and work experience, although the "experienced" 
entering students perform higher than those just out of liigh school. 

These results indicate that college learning does contribute to 
performance in ways that out-o f-collego life and work experiences do not. 
What is the nature of tliis contribution? One important part of learning 
at Alverno that seems to emerge again and again is the value of actual 
involvement in situations that require students to perform. Clinical 
experiences, OCllLs, taki[ig on an additicnai resi)ons ibility in a Job one 
currently iiolds, applying new concepts to day-to-day situations, r<'flecling 



• \{hat have I learned in college? 
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on one's performance in a seminar group, are all part of experiential 
learning ,"^ 

Experience is an important part of learning. But it seems that 
"learning to learn" requires experience coupled with reflective, structured 
opportunities to develop one's thinking abilities. "Learning to learn" from 
experience happens when students are able to "think": to stand back from 
the experience, to reflect and analyze, to self-assess, to link ideas and 
concepts in order to make -sense out of experience, to guide future actions 
and even to select the experiences from whicli they will learn in 
the future. 

Once a student learns how to learn from experience, she is much better 
able to "make sense" out of her previous work and life experiences. We find, 
for example, that on some inventories students witli extensive previous work and 
1 if e experience seem to make more sophi:jt Icated relationships after only 
two years in college than persons who spend two years in college right after 
high school. Apparently, the more experience you have, the more you are 
able to test out college-acquired ideas, concepts and frameworks against 
remembered situations and actions. 

Remember, however, that Lraditional-age students graduate with more 
developed thinkin[/ abilities than tlie older student returns with — they 
are better able to conceptualize, to create elaborate conceptual frameworks, 
to identify cause-effect relat ionsliips against which to analyze tlieir 
exi^er fences, and to self-assess. Can tliey also use tliis ability to "learn 
to learn" on the job, where it will, be critical to realizing their personal 
and professional career goals? 

^A. Doherty, M. Mentkowskl, and K. Conradv Toward a Theory of Under-- 
graduate Experiential Learning. In M. Keeton and P. Tate, (Eds.), LenrnJng by 
Experience — Uhat, Wh y, Mow (San Francisco: Jossey-Bass 1"J78) , pp. 2*3-35. 
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HOW DO STUDENTS LEARN TO LEARN AT WORK? 

WliAT ABILITIES DO THEY USE IN NEW SITUATIONS? 



\^ile our analysis of interview data is not complete, it seems clear 
that work experiences during college are important to students, and help 
them to '^translate" learning to make it work for them during their OCEL 
or clinical experiences. Here is an example"^ of one studen\'s comments as 
she describes "learning to learn" on a special project she completed during 



For my OCEL, I chose a rather large task that had been coming up 
for a long time in our organization. When it came to a head, I 
asked to take it on as an OCEL; it involved implementing a change 
in our organization that would impact many people. My actual boss 
was my OCEL mentor. And then I was taking the "experiential learn- 
ing" course with my Alverno instructor, who had me doing these 
experiential learning logs. 

At the time, I was a secretary. Not that I was a typical secretary — 
I did the purchasing and I supervised clerical staff. But I can be 
confident as an individual now, separate from my job, because for 
the first time, through my OCEL, I was able to view my job from a 
different perspective — something more than just a job was involved. 

Well, I took on this change. It was tough. Many of the people I 
v/ork with are in a different field and have very high qualifications. 
And I was having to confront them because I was making the decisions. 
I would often get treated as a secretary and not as a professional, 
not as a peer. Sure, it's possible to relate on a friend to friend 
basis in many situations. But when push comes to shove in a work 
situation and decisions are being made by someone you feel inferior to 
or who feels inferior to you, then a whole new set of circumstances 
are created. 

My OCEL gave me tlie opportunity to view that situation I was in from 
a different perspective and in a very logically set mode. 

HOW DID THAT HAPPEN? 

Well, to keep these logs I. had to constantly ask myself very specific 
questions about what I was doing. That was very important. 1 had 
to' take that work experience that I've been in for years and years — 
liomel It was probably the hardest thing I've ever had to do. I 
worked and slept and ate and cliewed that task for four months. 

'aU interview tiA^duples are edited to exclude any in f o riiiaL i on that 
could identify the contrilnitor , to maintain confidentiality. 
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an OCEL: 




IN WHAT WAYS DID YOU DO THAT? 



Well, first, I guess, it was becoming aware o£ all the things that 
make up what you actually do on the job, and then attaching some 
ideas to them. It was a conscious effort to feel more in control. 
I used to do things so intuitively and then feel very shaky about 
them. This was a means to move out of that realm of reaction, to 
some form of action. 

I've learned that there are more ways to reflect, and there are 
more ways to link. When everything you're doing is new, it's 
difficult to tie into something else. The .reflection process is 
almost impossible and very uncomfortable. It seems easier to make 
connections when you have some kind of framework or grid against 
which to compare your experiences. 

For example, I was able to bring in some sense of organizational 
theory or behavioral theory. And then I began to plan long-range, 
and sort of stick r.o it. This plan allowed me to see where I 
deviated aiid why. As I looked back on the decisions that I made 
at work, many had a very direct relation to something else that I 
knew or that I had experienced. I began searching for alternatives. 
I began to see the differences in profit vs. non-profit management, 
as we discussed in class. I began to understand that everybody has 

different perceptions lhat there won't be consensus among people 

on why certain things were happening. 

The OCEL integrated all these ideas for me. That was really benefi- 
cial ~ and I think it allowed the change I implemented to go well, too. 



IN WHAT WAYS HAVE YOU LEARI^JED? 

i learned through my OCEL that what I was doing at my job was a 
process; changing anything in an organization takes a great deal 
of time. All of the activities such as setting forth how the change 
would occur, keeping staff apprised of possible alternatives, 
communicating my thoughts and ideas to my boss, getting his feedback 
and reaching consensus, determining just how each staff person ijhould 
be involved — just simple things like making choices — each of 
these was part of a process. .Before, each of these things v/ould have 
had too much importance. Each disagreement, each agreement, would 
have carried too much weight — the highs and lows would have been 
too pronounced. Now, however, I v;as able to go into this change 
with a perspective on the whole thing. In each incident, I could 
see it as a part of a solution — each Incident contributed to a 
whole process that was gradually getting somewhere. 

ARE THERE ANY OTHER WAYS IN WHICH YOU'VE LEARNED? 

Well, I'm pret:y sure we learn as much from each other as we learn 
from a text. Learning that goes on through conversation and 
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discussion, through group work, or just sitting over coffee 
discussing what we read confirms or disconfirms our ideas. I 
think tliat learning can take place in any situation. I can't 
imagine sitting in a room by myself with an encyclopedia and 
coming out very much the wiser. We each bring with us our own 
sets of perceptions, the other experiences we've had, and people 
are able to lipten and to tell what effect those experiences 
have. To understand what.it means to bring your own perceptions 
and learn from other people's as well allows me tq grow personally 
as well. . 



WHAT WERE THE RESULTS OF YOUR OCEL ON THE JOB? 

ii,e change was accomplished to everyone's satisfaction, and I was 
given a promotion. I have settled into my new duties well, and 
now my boss is willing to trust me with more things, to send me 
out of town on trips, to have me do research. There is an atmos- 
phere of success. Also, I feel more in balance — not so up and 
down toward my job — and that balance was achieved through that 



IN iNHiAT WAYS DID YOU GROW PERSONALLY? \ 

Well, I think I made a major change in the last six mor.ths. I am 
more likely to mull things over, and not react as quickly. I'm 
not so tempLed to respond off the top of my head as I normally 
might have before. I can say 'I don't know' and take things under 
consideration, or I can do a little more digging on some problem, 
instead of Reeling the need to answer. And I value challenges 
more. 

I've also begun to feel fairly competent analytically — in think- 
ing through problems. And in being more open to trying solutions. 
I feel better about most decisions I make. 

miY IS THAT [MPORTANT? 

It's important to me to remain as objective as L can. Always 
acting out of my intuitive mode is something I want to get away 
from; so then, knowing why T do things is im|)ortant. 

This inCervioA'/ .;uggests a number of: abilities that the student bring 
to bear ou the problems slie faces, on the job — problems she has an oppor- 
tunity to discuss and analyze during her weekly seminar on campus. This 
student also completed a number of 'Mogs" as j)art of the course assignment 
which she says assisted her to "ask some very specific questions/' io 
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further analyze and reflect on her work experience, to draw relationships 
and to identify which changes ir. work plans — and her own behavior — 
she wished to make. 

First, she discusses the work experience itself, and ^'becoming aware 
of all the things . . you actually do on the job." She speaks of finding 
more ways to "reflect." Here she demonstrates perspective-taking, the 
ability to "view that situation I was in from a different perspective and 
in a very logically set mode." 

She also speaks of linking and tying ideas to each other, and making 
connections, which are rasier to make "when you havj some kind of framework 
or grid against wiiich to compare. your experiences." Her framework consisted 
of principles of organizational theory, and styles of management in differ- 
ent organ izat ions . 

She contrasts her new working style of "moving out of the realm of 
reaction to some form of action" with her previous style of "acting intui- 
tively and then feeling very shap.y. Knowing why I do certain things is 
important to me." Her new style seamed to enable her to "feel more in 
control ... to value challenges more. I'm not so up and down. I can 
do a little more digging on a i)roblem instead of feeling the need to 
answer. I feel competent analytically." In addition to her own increased 
confidence, "my boss actually changed the way he thought of me and my 
abilities — I actually received a promotion. " 

Reflecting on what she has learned, she now sees her job as a process, 
that her actions fit together and are directed toward a goal. "Before, 
each little incident had too much importance." Now siie sees each event, 
"as part of. a solution ... a whole process that was gradually getting 
somewhere." 
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Examples like these are exciting because they help to uncover how 
students learn on the job. With many more and different examples, we can 
improve our understanding of the abilities that make up learning to learn 
at work, and how it compares to classroom learning. We can then create 
-better OCEL and clinical experiences, and we will also be better able to 
help students take on more complex responsibilities in jobs they hold while 
still in school, as well 'as in the future, 

HOW DO ALUMNAE LEARN TO LEARN AT WORK? 

WHAT ABILITIES DO THEY USE IN NEW SITUATIONS? 

To illuminate the abilities thit make up learning to learn at work, 
we can also turn to observations and insights from alumnae interviews. In 
1978, the senior class participated in the study by completing the inven- 
tories, and over half also contributed a two-hour interview at the end of 
their senior year. In 1980, we sent a careering questionnaire to this group 
of • alumnae (similar to one given to nhe 1980 and 1981 senior classes) and 
most of those who had been interviewed in 1978 were interviewed again in the 
summer. We are now working to analyze these interviews, to see what we can 
learn from our alumnae. 

The transition to "life after college*' is only one focus of these 
interviews. But it is an important one because aluiiinae take the opportunity 
to reflect on what they have found difficult, what seems to cause stress and 
frustration, what skills and abilities they are able to call forth in working 
through difficult times, what seems to work and what does not. They can also 
help us understand what kinds of strategies they use to deal with prof es5p'ional 
problems, and can critique Alverno's current program in Ught of "what I 
needed." 

Tl)K* first tost, of course, i.s the extent to which alumnae actually find ^ 
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jobs. Last year (1980), of the students about to graduate, 94% expected to 
work after college. The alumnae in this study (1978 graduates) report that 
94% actually are employed. Seventy-nine percent of the 1980 seniors expected 
to find work in" their major area, and 88%^of the alumnae actually found 
positions directly related to their majors. So Alverno graduates are success- 
fully finding jobs iu their chosen fields. 

U^ile nearly all ^of the alumnae are employed, they are not all in the 
same positions they took just after graduation. Indeed, we found that in 
two years some had already been promoted, questioned whether they wanted to 
stay in the position or in:.»:itution they were working in, changed jobs, or 
even changed professions. Our alumnae have had to deal with change and 
challenge since graduation. 

The following interview excerpts wllJ. illustrate some of the variety 
of these experiences and challenges. To get at these and analyze them, 
we asked a variety of questions: 

• What was it Like leaving school and starting the life you 
have now? 

• In what ways is learning still a pan of what you do? 

• How is learning now different than it was when you were 
in college? 

• What kinds of abilities are most important in making the 
transition from college to life after college — to new 
kinds of work? 

• To what extent are you doing what you expeci^ed you would be 
be doing? 

• Have there been any times during your transition from school 
to your current occupaL ional act ivit les that you found 
particularly difficulty or problematic?-^ 



The complete set of questions are found in M. Mentkowski and N. Much, 
Alverno Colle ge Alumn a Pcg^spect ivesJUU^^ (Milwaukee, WI : Alverno 

FroductiorsT 1980) . 
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In our preliminary analyses of the interviews, we find that the need 
for flexibility and adai)tability is important for making a successful transi- 
tion from college to work. For most grcxduates, things did not always work 
out exactly as they expected. They h'lC to make adjustments in their thinking. 
These interview excerpts illustrate thinking, changing and adapting. Consider 
the following example of a woman who got a major job offer: 

I got the promo tier. It was five levels up, a very large jump. . . . 
The promotion was tn [a city 100 miles away] so I had to make the 
decision. If I wanted the ■ promot ion I would have to move there 
unless I wanted to commute. . . , Being that I h^d a family and 
husband to consider, it had to be a joint decision. We decided 
we would go based on my job transfer, but it would have to be over 
a period of 5 or 6 months before we actually made the move. In 
the meantime I am doing a lot of staying there and commuting. . . . 
I didn't knov/ ±f ifiy husband would be willing to watch the children 
on days that^I had to stay overnight ... it ^us a little hard to 
swallow at first. I think he felt like he was o.^ing left in the 
lurch, but he has come a long way. ... I think we, as a family, 
have learned a great. deal from this transition. 

Needless to say, she had to rethink many of the choices she had made up to 

that point. She and her family also had to adjust: to a commut ing- relationship , 

something none of them had anticipated. 

One of the themes that comes up often is that alumnae experience more 
pressure and stress working than they did in college. As one alum said, 
"Going to school, from my perspective, is much more relaxing, even .though 
at the time it aidn't seem very re^. axing. T find learning fun. It was much 
niore fun for me .to go to school than it ..s to work at a job.". 

Another challenge some graduates faced was disenchantment as their 
'.'•.fst position stopped providing new challenges: 

I came to a point in my job when I felt I had learned as much as I 
v/anted to, and maybe now it was time to move on to something differ 
ent. I put. off the decision for a long time because I was afraid 
to leave a job that I now felt secure in. . . . I guess it was some- 
thing r really had to sift thnMi^Ji i:iy mind'. ... I finally, decided 
that I was losing the things L felt were important and ' needed to 
get out of it in order to maintain a professional type oi st.anding 
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• with myself. ... I would go to work, put in my eight hours, l)e 
kind of crabby, do my work as fast as I could, and leave. Tlien I 
v^/ould go home and be depressed. ... T got to the point wherc^ 1 
iiad to sit down and decide whether tliat was what I wanted to be like, 
and if; I could live witli myself. I couldn't. 1 had to get a new 
job. . . . i'm glad I made the decision. 

The decision to change jobs is seldom an easy one. This alumna grajjpled 
with it, reflt?cting on lier beliavior and sorting out her i^riorities until she 
reached a firm decision. Al the time of tlie .interview she had been in Uv.v 
new Job for a month and reported feeling excited about the new learning she 
was doing. 

Do alumnae have to learn at work? Yes: Learning on the job was clearly 
a major part of wliat each alumna faced. As one alumna said, "You miglit think 
the teac!ier's lounge after scliool is for relaxing — I found it to he the 
place I learned the m.ost . I sat and listened to other teachers talk about 
tlieir probl^^ms, I analyzed in my own mind what they did, and that help^id me 
when I faced similar situations my first year." 

Three of tlie abilities that seems to come to the fore are reflecting, 
analyziiig. and creat ing plans for action. We hear alumnae tell us how they 
stepped back from problems — reflected, thought tiiem through. They asked 
themselves what it vas that was bothering them, what their goals were, and 
what kind of acdon fliey needed to take. They took time to plan their future 
actions rather than act impulsively. 

In addition, alumnae usually made some reference to a skill tliey used 
that assisted them. Some mentioned role-taking, some wrote out conversations 
between themselves and others and then analyzed them for patterns, some 
compared "where T in my job now" with "where 1 want to be in my profession." 

One super-. 'r had a difficult encounter witli an employee: 

I turned an individual down for a promotion he had c?pplied for 
and he became very irate and started veiling. ... I found myself 
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becoiniru; uxLrcMm'ly annoyed with liLm, raising my voice . . . and 
after the wholu thing was over I was very nncomf or Lab Le . 1 had 
been total.lv uaprepared for that type (if response. ... I was so 
unsatisfied with tiie way I handled tlie situation tiuit fc^r several, 
days I really thought about it- I tried to go baek to tilings 
T had learned about how to effectively handle situations. In my 
own mind, T role-played what 1 would do if it happened again and 
it did happen again, with the same individual. Several days later 
he came back to me and tried to convince me to change my mind and 
again raised his voice and started carrying on. I was very calm 
this time because 1 was prepared. . . . The v^/hole thing came off 
beaut i f u 1. ly . 

I'll is woman liad a rare opportunity for a second chance to interact with 
the employee and try out what her role-playing had taught her. She also 
learned the benefits of being so well prepared to deal with a person about 
such a sensitive issue. 

Another aJumna had "a very rough second year of teaching," 

There was something major that went uu every week. If it wasn'i 
a problem with things missing, it was a problem with parents. 
I would come home at the end' of each day ^. r week and write do\.m 
all the things that happened ~ just the hare facts. This is 
what happened, this is what 1 said, this is what they said. Then 
r would reread it and look at 'it and analyze what the real p.roblem 
was why things didn't go the way they should have or the way 
I would like them to. I would think about what I would do if a 
particular situation would come up next, and then T took action 
o n it. 

Her situation did not improve much, but she became better able to cope with 
it by her process of analyzing and planning. Her learning process also 
included "Just talking to family members and friends that were not in the 
situation. 1 just did the best I could. There was nothing else I could do.'* 

Another alum was passed over for a supervisory position and thought 
she had been treated unfairly. 

instead of be in, the way I v;as maybe three years ago and saying 
"What the hell do you mean?", I sat back and thought. 'V\ll right, 
what are the things that 1 want to say to get mv point across? 
Do I think this is a legitimate complaint? How am 1 going to tell 
this person without making her do things worse to me than she is 
already doing?" When the time came, I felt I was ready to do that. 
It wasn't that day, but a coui)le of days down the line when I had 
time to sit back and organize myself and think about what I really 
needed to say to her. It went fine. . . . There were a lot of 
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thini.;s I. said LliaL wore i.mpcn-tiant . [ Lliink it: worked out really . 
well, because after Lhat she had much more respect for my point 
of view. 

This woman did not "fly off the handle" as she might onee have done, but 
spent considerable time thinking and analyzing the situation before taking 
action. As a result, she came to a reasonable and effective solution. 

The alumnae also noted several other abilities that contributed to 
their transition from eolluge to work. For eixample, organizing and [)lanning 
action were importanL' to several. "I really value my organizational skills. 
I rely very heavily on lists and time schedules." Another said, "I tend 
to approach my job in a very organized fashion, and although many of my days 
are nor. organized because of unexpected occurrences that I have no control 
over, 1 still have a plan for myself." 

One alum is "learning to interact with people without judging them. 
I try to see the person as a person and accept them for who they are." 
yXnother said simply, "1 think one of the abilities that helped me is tliat 
school has t; Iven me confidence in myself." 

HOW DO P ROFESSlONiX LS LEARN TO LEARN AT WORK? 
WHAT ABILITIES DO THEY USE IN NEW STTIJATIONS? 

Studies of outstanding professionals are beginning to illuminate hew 

persons learn to learn at work, and how they transfer learning and us. their 

abilities in new situations. While the study of outstanding women managers 

is still incomplete, some interesting facts are eme ing from a preliminary 

analysis of the demographic data about the relative e-.reets of education and 

experience . 

Women managers a. ! executives from 50 organizations in the Milwaukee 
area part icipa ted in this study. Of the 103 women , sixty- four (621) 
had a bachelor \s degree or more education; but only fifteen (24'/') of these 
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college graduates majored in a field related to management. (Another nineteen 
women — 18Z of our sample — were taking courses in college wlien the inter- 

viev;s were ei'llected.) 

Why are these women, 85% of wl-.om do not iiave their educational crec^en- 
tials in management, making it in management? What abilities did they earn 
that allowed them to perform in Mie.ir present job? We are hypothesizing that 
one ability they may share is the ability transfer generic competences 
learned in college or previous jobs to the jobs they are in now — to apply 
gi'ueral skills in new situations. 

This hypothesis is reinforced when we look at their experience. Almost 
two-thirds of these women were not yet 40 years old. Fifty-two percent of 
. tliem had been in their present positions two years or less; 21% had been in 
their present positions from 3 to 4 years; and only 27% had been in their 
present positions 5 years or more. Thus, most of the women have relatively 
little experience on which to draw in their present positions. If their 
education is not directly related to their management roles, and they do not 
hiwe much experience in their present positions, v.e hypothesize that they are 
transferring generic abilities (similar to ou: competency of analysis, 
problem-solving, communications, etc.) from previous education and experience 
to their current jobs. They may then pick. up technical skills and specializec 
knowledge and expertise on-the-spot. 

Each of these wcman managers was asked, in an hour long interview, 
to describe six work situations about which the interviewer asked tlie followii 
1 

quest ions : 



"""David C. McClelland, Behavioral Even t Inter view (Boston: McBer and 
Company, 1978). 
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Can you rucall an ef feet ivc or inoffoctive experience? 



--uniat: happened? 
-Uhat Led up to it? 
- W 1 1 o was involved? 

-What did you think, feel, want to do? 

-What did you do? 

-iNJliat happened as a result?" 



While we are still in the process of analyzing all the interview.^; we 

collected, one example clearly illustrates adaptin^^ abilities learned earlier 

to a new position: 

What happened? iNJliat led up to it? 

1 had v/orked for a consumer product company. When 1 first came 
to work here the nature of this company's products was new to me. 
I was very uncomfortable with the terminology people used. These 
people 1 was dealing \.;ith had been with the company many years. 1 
set up meetings with various divisions to review their marketing 
[)lans with chem. 

Who was invo lved? 

Fifteen marketing directors and myself, 

^Vhat d id you ^o^? 

I went individually to get acquainted with some of the directors 
before^" our meetings. 1 reviewed their marketing plans prior to 
meeting with them. 

From that 1 developed i year-long public relations plan: "llere^s 
a schedule of various releases and literature you should send out 
relative to thi^ pr(.)duct. This product is significant enough to have 
a news release.'* 

Tlirough talking with them 1 also set up parameters b .sed on the 
products and customers. By giving them parameters I could ask them 
of their new product, "Does it fit this bill? OK. The trade show 
you'll be introducing it at would be an ideal time for a. news confer- 
ence." We also discussed any articles that could be written. 

1 followed thru, kept them informed of what we've done, the timing 
of it and mailed them news clippings. 

Wh a t were your thoughts and feeling s? 

I was not sure of the products and to whom they were sold. I 
was very confident in setting up these meetings, reviewing marketing 
plans and developing P.R. plans, sure of my ground in that area. 

1 was very awa-re I was asking extremely basic questions. I was 
aware of being new and different. I was very careful and didn't 
want to embarrass this department by appearing too "green". 
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What liappene d _a s a result:? 

It^s hclpT^J 'this division to get acquainted with the markets. 

The me^^tings not only helped directors but also helped me 
b':;-':ome acquainted with the various departments we market. Our 
department might have put out the same type of work, but 1 don't 
think 1 would 1 've understood it as well. 

It took time, but I was also helping my assistant to learn. I 
was putting my oi-^anizational skills and his knowledge of the 
company together . 

I don't have that feeling of having to account for my background. 

In this example, it ^is clear that this manager did not have the 
technical knowledge she felt sh- needed. But she used other ah ties. She 
was proactive, initiating interaction with the marketing directors. She gave 
them information about how to set up parameters >r news releases and shows, 
and even selected products for such handling. She followed up with more 
information, and she was very careful to assess the impact of what she was 
doing. Furcher, she showed accurate self-assessment, noting areas where 
she is sure of her ground and where she is not. It seems clear that she was 
''learning on the job" — combining the competences she used m this situation, 
'ith the crucial ability to transfer them to a new setting as learning 
tools . 

Our interview analysts also point out some other interesting observa- 
tions from their early work with the interviews. They are finding that the 
women managers demonstrate a wide variety of competences. Most of the work 
situations these women te seem to call for demonstrating a number of 

abilities siniulta- v. y and to require integrating them as well. 
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DOES A COLLEGE DEGREE MAKE A DIFFERENCE TN THE KII^DS 
OF ABTLITIES DEMONS TR.. TED BY OUTSTANDING PROFESSIONALS? 

A colleger degree has been eritlcized as merely a "paper qualification," 
a necessary line on oneVs resume. So-. ^;ue t:hat persons without college 
degrees can perform just as well if liney have the same on-the-job training 
and experience. In the :«... j:es of outstanding professionals we are conduct- 
ing, we have been especiilly Interested in the relative contribution of 
education and job experi:/ace. 

A finding from the study of registered nurses"'" suggests tliat experience 
is not enough — In fact, education is critical. First we identified several 
abilities that describe outstanding performance, drawn from what professionals 
said tiiey actually did in their jobs. We then examined the extent to which 
eacii of these abilities was related to education (a bachelor's degree vs. 
less than four years of coll :2,e) and experience (five years or more vs. 
less than five years), 

2 

Tiiree of the nine abilities or competences we identified are: 

HELPING Taking action to help a client or 

subordinate when both are seeking the 
same goal. ' 

INFLUENCING Taking action to change a client or 

subordinate's behavior when he/she may 

have a different goal than the professional. 

v:OACHING Using a variety of strategies to instruct, 

train or encourage clients or subordinates to 
change their behavior and their mo tivation 
to accept more responsibility for themselves 
or for their jobs. 



"^M, Mentkowski, V. DeBack, J. Bishop, Z. Allen, & B. Blanton, 
Develo ping a Professional Competence Model for Nursing Education . Paper 
presented at the meeting of the American Educational Research Association, 
Boston, 1980. . v 

•^In-depth descriptions of each ability can be found in tlie Codebo. i<.. 

341 : 

377 



18 



One , iportanL dLfference beLween tlicse three abilities is thac heijn-nj^ is 
easier to demonstrate than influencing., wi)ich is in turn easier to demonstrate 
than coaching. If we review the bri./f descriptions we can see why. If a 
client who has a liectct condition agrees that he needs to exercise, I can 
help him get started. I may walk with him, go with him to exercise class, 
monitor changes, etc. What I must do will be far more difficult if the 
client does not agree. I must inf luence him to change his behavior, even 
tliougli he may not see its va^e. But if i am to have a lasting effect, I 
must demonstrate effective coaching . I must change his own attitudes and 
motivation to exercise, so that he takes responsibility for his o^^m wellness. 
The same may apply to other professions. To change the behavior of 
' a child who agrees to change becomes quite a different task when tlie cliild 
does not wish to change. Influencing may be required, and in the long run, 
coaching. A child with ^'math anxiety" or one who is engaged in a music 
therapy program will probably need extensive coaching. Getting a subordinate 
Lo take respon: 'bility for his/her job can likewise require a variety of 
coaching strategies. 

What did we find about the value of education and job experience in 

our study of professional nurses? 

HELPING Amount of education or experience was not 

related. Professionals with greater or lesser 
experience and greater or lesser education all 
performed helping equally well. 

INFLUENCING Amount of experience was related, amount or ^ 

education was not. Professionals who had five 
years or more of experience demonstrated 
influencing moje often, regardless of education. 

COACHING Amount of education was related, amount of 

experience was not. Professionals wfto l)ad a 
bachelor *s degree demonstrated coja_c_hin_g_ sigriif- 
ieantly moire often than those who had less than 
four years of coJ lege — no matter how many 
years* expe. ience they had. 
342 
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KxpcriencG was necessary to demons t: rate iiiyjl^^liLiDi?. P^^^^ because 
it is a more complex skill, than helpinj^. But opportunity for influencing 
is probably also -Mated to what kind of position a person holds — the 
staff nurse, at an entry level position, has less opportunity to deal with 
situations requiring influencing; than a more experienced supervisor. 
Education is critical for tlie most difficult: ability to demonstrate, coaching. 
Nurses witli a bachelorVs der,ree were s j ^ni i f leant 1 v more Likely to demonstrate 
tiie most complex end difficult of the professional competences. 

Two (3thcr competences were enhanced by education: 

INDEPENDENCi: Taking action when there is no external pressure 

to do so; taking tne advocacy role for a client; 
acting on her own judgment and taking responsi- 
bility for it. 

CONCEPTUAL I. :ING Linking information, using concepts, creating 

rationales for behavior and judgment. 

Professioncas with a bac!ielor's degree shewed significantly more instances 
of independence. Conceptualising behavior increase- significantly with 
experience, but pro f ess i onals with a bachelorVs degree were significantly 
less likely to make conceptualizing errors that included failure to link 
information and apply concepts, and to see overriding principles that could 
guide her behavior. 

Our coaclusioii is that v.reviaus job experience is important to develop- 
ing abilities and skills at work, and that a college degree is critical for 
the more complex abilities. Education and experience are both- important ; 
how can we make them work together? 
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WHAT ARE THE IMPLICATIONS FOR HICiiER EDUCATION? 

From our review of students, alumnae and othor professionals dunion- 
strat ing "le.arnLn^^ to Learn" at work, we c.in derive several imp Licat. ions 
for higher education. 

First, what abilities need to be learn., i and assessed in collejv" to 
enable learning to learn at work? It seems clear that learning at work 
requires perspect ive-tak i lu/, standing back from a situation one lias just 
experienced and looking at it from several points of view. Alumnae and 
j)rofessional managers have showT». us also that "thinking" — analyzing 
situations against some theoretical framework or goal and conceptualizing 
a plan of action — is critical. Role-~taking , writing out what happened, 
comparing possible courses of action against alternatives, contrasting a 
current situation against one's educated judgment, are some of the othei 
abilities used. Persons also generalized across a number of situations 
in creating an action plan. 

In the experiential learning courses and seminars that accompany student 
OCELs at Alverno, some new instructional tools are now being used that 
further strengthen "learning to learn" skills. One such tool, developed in 
response to the interview data, is the "Experiential Learning Incident Log."-'- 
This log asks students to record work situations in which they learned, and 
questions j.;uide the student to develop a continuous narrative. First, she 
creates an accurate description of what happened in the situation, focusing 
on the circumstances that led up to the incident, her own and others* activ- 
ties and conversations, anH the outcome. Then she records what she \<fas think- 
ing and feeling about whai she did and others did during the situation itself. 
The log questions then ask her to step back from the situation and 

■^Developed by the Office of Evaluation, Department of Management and 
Department of Professional Communications, Alverno College. 
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analyze what slie inlundud to accomplish, and to tala.' on the perspectives 
and intentions of others i.n the situation. Other questions guide her to 
analyze what she thinks ai>{ feels now about the incident, to look for 
cause/effect r elal i.onships . ukI to form generalizations across similar 
situations. Then she is asked to comment on what she learned, and to plan 
an i mp r o ved pt.' r f o rman c e . 

Once this is done, further log questions encourage tiie student to 
compare lier observations to theoretical frameworks she is learning. To 
help iHir develop her own "theories," she is also asked to discuss the 
ideas and concepts that guided her actions. She also identifies the skills 
and abilities she will, need in .^ituaf as like this .:e and specifies ideas 
and concepts that seem to apply now. After -he has completed several logs, 
she repeats this process ove.r a number of lier collected situations, in 
dialogue' with her peers and instructor. 

Another tool^ used in OCEL seminars heJps a student to evaluate and 
assess her own working style from the perspective of her employer. She then 
compares this "projected evaluation" with her mentor Vs actual evaluation of 
her work. Here she not only desciibes lier o^vn behavior, but takes on 
another's perspective, makes evaluative generalizations about her behavior 
from that point of view, and takes an objective stance about her work. 

It seems clear that college learning needs to provide some very 
important processes if students are to benefit from concurrent job ipcrienre, . 
and to be able to transfer abilities they learn in college to their luture 
work settings. Teaching skills in "learning tu learn" at work is -one way for 
hlgaer" education to prepare graduates who will not only find entry-level- 
positions but will also achieve mobility and growth in their career development. 



■^Developed by Patricia Hutchings, Coordinate r, English Department, 
and Allen Wutzdorff, Chairperson, Behavioral Sciences Division, Alverno College. 
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APPENDIX BB continued 

Alverno College 

:!,>rch 2, 1981 



Dear Participant, 

One my responsibilities as director of this study is to 
d u;:;;.^minate information as it accumulates, 7-ather than wait UTitii 
"firm conclusions" are in hand. As you know, I have shared pieces 
of infunnation with you in the past. With this leport, I am bringing 
some results to you that I hope you will find of particular interest 
and assistance. 

In tl.e last progress report, I described what we understood 
so far about tha development of thinking in college. T used several 
terms ~ analysis, cognitive structure, perspeCive-taking, abstract 
conceptualization — to discuss the initial findings "about thinking 
that seemed to come together after two and one-half years of work. 

In this report, I will be discussing thinking again, but as an 
important part of learning -to learn at work. How do students learn 
to learn during OCELs or other clinical work experiences? How do 
alumnae and other professionals who have contributed interviews and 
questionnaires learn to learn at work? What abilities do they use in 
new situations? ^ 

I am also interested in what you have to say. I will be discuss- 
ing this report with you in specially arranged individual and group 
sessions this month. Ac the end of the scheduled inventory collection 
day this year, I have also set aside time for discussing other issues 
and questions you want to raise about the work. 

I hope this report will both stimulate your thinking and express 
my appreciation for your valuable contr ibvit ion . 



Cor., ially , 




Marcia Mentkowski, Ph.D. 
Director of Evaluation 



MM: 'vp 
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APPENDIX BB continued 



Alverno College 



March 19, 1981 



Dear Participant, 

One of our responsibilities to you as a participant in the evaluation 
studios is to disseminate information as it accumulates, rather than wait 
until "firm conclusions" are hand. With this ^report, we are bringing 
some results to you that we hope you will find of particular interest and 
assistance. We would like you to receive some i mmedia te benefit from your 
par t i c ipa t ion . 

The August, 1979 written progress r^^port described what we understood 
so far about the development of thinking in college. Several terms — 
analysis, cognitivq structure, perspective-taking, abstract conceptualization 
— were used to discuss the initial findings about thinking that seemed to 
come together after two and one-half years of work. 

When we met with you in Fall, i980(or 1/81) ("What Have I Achieved: 
Feedback and Dialogue") we discussed the relative: effects of education and 
experience on the development of thinking and other professional abilities 
in women, as understood from recent results from student performance on the 
inventories, and uhe studies of prof es«^ iona Is , 

In this report, thinking is discussed again, but as an important part 
of learning to learn at work. How do s tudents , learn to learn' on the job, 
during OCELs or other clinical work experien^^es? How do alumnae and other 
professionals who have contributed intervie* ^ and questionnaires learn to 
learn at work? What abilities do they use n new situations? 

iiie report you receive after the May inventory collection will contain 
your third individual profile and group results from the Learning Style 
Inventory. Other reports will follow as results accumulate . 

We are also ilnterested in what you have to say. At your scheduled 
inventory collection time held during May 1-3, we will be able to discuss 
other issues and q?uestions you want to raise about the work. 

We hope this Itepcrt will both stimulate your thinking and express our 
appreciation for your valuable contribution. v 



EKLC 



MM: jr 



Cordially , 

^ i^^pt i ^^ t^^^^' ^^^^^ 1^ - 

Marcia Mentkowski, Ph.D. 
Director of .^valuation 



S.! Austin Doherty 
Academic Dean 
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APPENDIX CC 




Alverno College 



August 8, 1980 



I am writing to recognize and coramerd you on your contribution to the 
important work being conductedi here at Alverno on the outconj^s ot the 
college experience. 1 invite yo';. to a special feedback and dialogue 
session des'jribing recent outcomes of the study that I think you will 
find valuable during your ne::t yanr^s ork in your professional area. 

This session will be held dur ■ -g your first weekend this fall^ and is 

noted o^i the schedule that was mailed to you this week. The title of 

the session is '*What Have I Achieved? Feedback and Dialogue wich 

Austin! Doherty and Marcia Mentkowski, Director of Evaluacion, We 

have scheduled two identical sessions to enable you to attend: 



'Together we will present some of the initial study outcomes, including 
the development of various perspectives on learning you have achieved 
during your first two yt^ars at Alverno, as mef.sured by the inventories 
you c^apleted iu Fall, 197? and again in Fall, 1979. We also plan to 
review what is urderstood so far from the professional studies of nurses, 
and women managers and executive:^. We will dJ.scrss the abilities that 
have emerged from the interviews, and relate them to those we have been 
assessing here at Alverno. At this session, you wixl receive some materials 
that will outline ]>lans to involve all students \yho entered Alverno in 
Fall, 1977 in a final evaluation during acsessment week. May 1-3, 1981. 

As a contributor to this project, you have alre:my demonstraced the kind 
of professional commitment that will benefit not only yourself and other 
students, but your profession as well. Your future colleagues tend to 
have even more confidence in your abilities as a professional when they 
are aware that ongoing studies are being conducted to continuously dem- 
onstrate the effectiveness of the educational process you have completed. 

join those professional .women in the Milwaukee area whose contribution 
-S also reflected in the study outcomes we will share with you in this 
special session. _ 

1 welcome you to o.iother -cademic yerr^, and to this opportunity t o dit:cuss 
our mutual efiorts to prepare each other for oUi. future work. 



Saturday, August 23, 1980 in Wehr Hall 

11:45 to 1:00 — immediately after he colloquiuiTi 
all students will attending 



Sunday, August 24, 1980 in W:ihr Kail 
11:30 to 12:30 



Sincerely, 




A*, stin Doherty 
Academi c D2^n 



AD :mca 
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APPENDIX DD 



A Alverno College 



August 22, 1980 



Dear (Student's name): 



During your first week at Alverno, you are meeting with Dean Austin Dol.erty and 
Dr. Marcia Mentkowski in a feedback and dialogue session describing the outcomes 
of the evaluation study you have participated in since you entered Alverno in 
Fall, 1977. I am writing to lend my support to this work, to commend your 
contribution, and to ask for your continued assistance during Spring Semester, 
1981 . I also wish to communicate that all of us in the Behavioral Sciences 
Division are very enthusiastic about this project and are giving our full support 
to this effort. The insights we gain about the learning and abilities of adult 
students are invaluable in improving the curriculum and in providing the best 
possible assistance to you in meeting your goals. 

An example that comes immediately to mind is the group results from the Learning 
Style Inventory, which were mailed to you following your two previous participa 
tions. These results were presented to the faculty in late May. At that time, 
David Kolb, professor at Case Western. Reserve University, author of the Learning 
Style Inventory and originator of experiential learning theory, met with the 
faculty to discuss his recent insights on how adult studer-.s and career profes- 
sionals learn. Together with Dr. Mentkowski, he discussed Alverno student 
.preference patterns on the Learning Style Inventory and drew implications for 
college curricula. Dr. Kolb also met with faculty who are working co increase 
the ways in which learning can occur in the variety of off-campus ey.periential ■ 
learning settings students experience. Thus, the results from just this one 
inventory are serving as important guidelines for faculty, and have also vali- 
dated that students as a group leap dramatically in their preference for abstract 
conceptualizing after two years in college, an important step if learning .in 
settings off-campus is to accomplish its goals. 

I am also writing to ask for your continued assistance during the Spring Semester, 
in 1981. Since this work is an institution-wide effort, the chairpersons and 
faculty have set aside time for the inventory collection. We are well aware that 
many of you will have increased responsibilities as you near the end of your 
Alverno studies, and we have arranged for your participation this spring in a 
way that will, enable you to contribute as part of the regularly scheduled 
weekend of May 1—3, 1981. I will notify you shortly after the start of the 
semester in January, 1981, just where and when participation is scheduled. 
Those of you graduating this semester will be involved in December. 
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APPENDIX uD continued 



I know that you have had a number of opportunities to hear Dr. Mentkowski 
discuss the study purposes and outcomes since 1977 and have received three 
written reports. I have just read the report she is giving you now. ^^^_^^^ 'J- 
would like to add a note to her coinments, to underscore the importance qI . your 
contribution . 



You are an irreplaceable part of a longitudinal evaluation study. We are invent- 
ing time and resources in this project -- and asking you to contribute your time 
and efforts -- because we are interested in evaluating changes in learning, lo 
know how your class fares at Alverno, we really need to look at how effective 
the program is in promoting learning, from beginning to end. Aggregate data and 
group scores alone can obscure the unique growth patterns and achievements that 
ten us what has really iiappened in the educational process. Only longitudinal 
evaluation studies, looking at changes in learning across time, can reveal these 
pat te rns . 

The particular inventories used in this study look rather different from most or 
all of your course assessments, but they have been chosen as outside measures 
of general ability areas similar to the competences with which you are familiar. 
Many have also been shown to relate significantly to future professional per- 
formance ~ as we expect the Alverno curriculum to do. 

The benefits from this study will multiply over the years. Of course, you will 
receive individual feedback on the Learning Style Inventory once again, and 
other group results like the current report. Rut your participation will also ■ 
increase the status of your degree, in that your future colleagues tend to have 
even more confidence in your abilities as a professional when they are aware 
that ongoing studies are being conducted to continuously demonstrate the effec 
tiveness of the educational process you have completed. In taking this oppor- 
tunity to again demonstrate your professionalism by contributing to r.uch an 
effort you join 8A nurses and 115 women managers and executives m the 
Milwaukee area who have also contributed a picture of their abilities. Your 
work complements and extends similar participation by students from two weekday, 
classes and the alumnae of the class of 1978, many of whoia interviewed on campus^^ 
this summer to create a picture of the abilities needed for "life after college. 

Your contribution toward describing abilities learned in college by adult women 
in Weekend College can make a dif f erence==--=fe©=fS?i , to other women in higher 
education, and to the professionals you will join as colleagues. 

Sincere ly , 

Allen WutzdorTf 
Chairperson 

Behavioral Sciences Division 




AW:mt 
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APPENDIX EE 



3401 5 39th Street 
MhwauKee.VVI 'V321C> 
(414^ 1)4/ 3999 



A 



Alverno College 



November 14, 1980 



Dear (Student's name): 



I am writing to remind you of the feedback and dialogue sessions 
that Harcia MentkowskL and I will be conducting Saturday, November 22, 
and Sunday, November 23, and also to notify you of an addition to 
i: > schedule. Several students have told us that they cannot attend 
the Saturday sessions because they have class until 1:00 p.m. In 
order to allow everyone to attenJ , we have scheduled an additional 
^..-ssion Saturdc-y, from 1:00 to 2:00 p.m. All sessions will be 
neld in Alumnae Hall. 

I've enclosed a form for you to indicate which of the three sessions 
you will attend. If you cannot attend any of these sessions, we 
will call you to schedule another time. 

I am looking forward to seeing you next weekend. 



Since re 1 




Austin Doherty 
Academic Dean 



AD :mca 
Enclosure 




APPENDIX EE continued 



NAME: 



I will attend one of the sessions scheduled, 



Saturday, November 22, 12:00 - 1:00 



Saturday, Noveml 22, 1:00 - 2:00 



Sunday, November 23, 12:00 - 1:00 



I cannot attend any of the scheduled sessions. 

please call to arrange another time. | 1 



PLEASE RETURN TO MARCIA MENTKOWSKI ' S MAILDRAWER BY SATURDAY, NOVEMER 22, 
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AJverno College 

January 7, 1981. 



D'eax" Weekend College. Student, 

Remember the invitations you received li ..t semester to attend a feedback : 
and dialogue session with Marcla Menc^vowski and me? While most of the students 
involved v/ere able to attend, some of you had scheduling conflicts, euc, that 
did not allow you to come at th-.: tir-c^^ we scheduled. Consequently, we are 
scheduling two additional feedback and dialogue sessions: 



Saturday, January 1"^ . 12 noon to 1:00 p.m. 
Sunday, January 18 12 noon to 1:00 p.m, 

(Bring your lunch if you wish) 



Alumnae Hall 
Alumnae Hall 



1 have enclosed a form for you to fill out to indicate which session suits 
you best- 

Togetiier we will present some of the initial study outcomes, including 
the development of various perspectives on learning you have achieved during 
your first two years at Alverno, as measured by the inventories you completed 
in Fall 1977 and again in Fall 1979. We also plan to review what is understood 
so far from the professional studies of nurses , j^omen managers and executives. 
We will discuss the abilities that have emerged fro^m the interviews, and relate 
them to those we have been assessing here at Alverno, At this session, you 
will receive materials that will outline plans to involve all students who 
entered Alverno in Fall 1977 in a final evaluation during assessment week. 
May 1-3, 1981. Other materials on the study outcomes are also included in 
your packet. 

Your professional conmitment as a contributor to this project is greatly 
appreciated. Welcome to another semester, and to this opportunity to receive 
feedback and to dialogue on our mutual efforts. 

Sincerely, 




Aus( In Doherty 
Academic Dean 



ADrdvp 
Enclosure- 



353 




38d 



APPENDIX £E continued 



NAMF 



I will, attend one of the sessions scheduled: 

; ^ Saturday, January 17 12 noon to 1:00 p.m. 
r 1 Sunday, January 18 12 noon to 1:00 p.m. 



I cannot attend any of the scheduled sessions. 

Please call to arr -^-^- ither time. ; J 



PLEASE RETURN TO MARCIA MENTKOUSKr S MAIL DRAWER BY SATURDAY, JANUARY 17. 
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APPENDIX FF 
101 south 39th Stre«t / Mllwau»«e«. Wl 5321S 



I 



MO 



"O:. (Faculty member's name) 



'ROM: Marcia Mentkowski 
S- Austin Dcherty 

3ATE: April 3, 1981 



r 

ERIC 



Inventory collections for WEC students entering Fall, 1977 

AS you know, this Spring is the final inventory collection for our longitudinal 
study of ^.ollcqe outcon'es . 

Students who entered Alverno in Fall, 1977 are participatxng . This year We 
have schudeled the WEC inventory collection to take place during the weekend 
of external assessments (May 1-3) . Students who complete their external 
assessment Friday, May 1, are scheduled to participate in the inventory col- 
lection Saturday, May 2, and students who complete their external assessment 
Saturday will be participating in the inventory collection on Sunday, May 3. 
All participants were mailed their schedule April 1. Two weeks before that 
mailing, these students were sent a letter from their Division Chairperson 
inviting their participation and explaining how their schedule came about . ^ 
Also included with this letter was a letter from Marcia Mentkowski with 
"Questions and Answers about Evaluation Studies at Alverno College", which 
gives a detailed rationale for student involvement, and describes how their 
participation will benefit other students and professional women. (See mater 
ials attached) 

Now we wou. • tr -.all, .listribute to e,.,jh participani v copy of 

the progress ..-port, whicn as you may know we created to describe to these 
participants "ome of the initial results of the study, to let them see some 
outcomes, and to encourage their participation. 

Would it be possible for one of us to come to your class for just a few 
minutes to speak to the persons involved, and to give them their personal 
copy of the progress report? would be visited oh 

and students would be involved. 

Please return the bottom part of this memo to Maicia's mailbox by Tuesday, 
April 7. Thank you I 



j j I can. assist you by making my students available to you as scheduled above, 

□ 



I will be unable to assist you, 
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APPENDIX GG ^, i^-r'.-\vi ^'^:'V. 



A V V » 



Alverno College 



March 19, 1981 



Dear Participant, 

You may recall my letter to you inviting you to continue your participation, 
during external assessment weekend May 1-3, 1981,. in the evaluation studies 
on the outcomes of the college experience. My letter was distributed during 
your session with Dean Doherty and Marcia Mentkowski ("What Have I Achieved: 
Feedback and Dialogue"). 

The third and final inventory collection from the V^eekend College Charter 
Class (students who entered in Fall, 1977) will again assess your abilities ^ 
in a number of areas related to future professional performance and will help 
complete the picture of your college experience over the years. 

We are well aware that many of you are nearing the end of your studies, and 
may have more responsibilities this semester. Therefore, we are reviewing 
your personal schedule for external assessment weekend,. We are scheduling 
your inventory collection period to consider your external assessment( s ) 
to include time for lunch and "breaks," and to minimize fatigue. You will, 
for the most part, be working at your own pace. Students take different 
tmounts of time to complete the inventories; most complete the work well_ 
within the time scheduled. Bat you can judge best from your experience just 
how much of the scheduled time period you will personally need. 

You, will be receiving your individual schedul e bq April 2, 1981. 

Your schedule will include time for your external asses;^ is " 
inventorv partici'" , 

Vou arc an i replaceable part of the l-ongi tudinal study. You have already 
demonstrated a commitment to research that will benefit other students and 
professionals for years to come. And we will continue out coitimitment to you 
to apprise you of results. You vill, of course, be receiving your Learning 
Style Inventory profile again. The progress leport of some current results 
vou will receive in April, also describes some curriculum improvements built 
on initial study results. You will continye to receive results, even after 
graduation. 

Your participation in this important work is invaluable and greatly appreciated 
y • Sincerely, 

Allen rvulzdo^ 



AW: Isl 




Chairperson 
Behavioral Sciences Division 
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V ■ 

Alverno College \ 

April 1, 1981 



Dear V/EC Colleague: 

Congratulations! You have nearly completed another challenging ser.ester 
of -weekend College. To culminate this experience, ani your learning, we .have 
scheduled the spring raund of VEC External Assessments. 

Based on the courses you are taking, your external assessrr.ents are listed 
below. An inventory collection period has also been arranged. for you, as the 
attached note from Marcia Mentkowski explains. 



Assessment Time ■ Location 



"^at. May 2 Inventory Collect, ion . - llogp, A 

Period •■•iTi. 



Please report promptly at the times indicated. 

If ycu have c^ny questions about the External Assessment, '?lease cal] n 
Lorl :'iller in the Assessment Center at 6^7-3^28. Questions related to^the^^ 
Inventory Collection Period shoul:: be directed to Marcia Ment\owski at 6uT-36ll 

We Join in wi^-hing you every success as you demonstrate your unfolding 
abilities ! 



Sincerely 




Lavetta Meyer 
WEC Coordinator 
Assistant to the Dean 

Lori Miller 

WEC Assessment Coordinator 
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